2024-09-21T06:46:12.578 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:46:12.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:46:12.701 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913572' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNFB7t4utGdHQB+kacGG1MooygB2bq5gkX98MYv0oZR/U4fDZRvLpMWa9YLqkT20GF0N9RgYLa7svWNQgJu9jic= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlvinPxsvtYtEtcxVrOPLHsHRh7YxQuabkYR/LkvdnNiPolx8vce1ZfNuH4OlBKdKWQ8WVn/nlnkwA9ns4ZWy4= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSBcNHUahVJiV1zNdYY1AhpD4tv56qiyIORFTgO6s2+9yejRf3HQtW3UiXD5eZsbecL/apI7rU1X6tHDzcGyV8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:46:12.702 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:46:12.702 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:46:12.703 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:46:12.704 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:46:12.724 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:46:12.724 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:46:12.725 INFO:teuthology.packaging:ref: None 2024-09-21T06:46:12.725 INFO:teuthology.packaging:tag: None 2024-09-21T06:46:12.725 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:46:12.725 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:46:12.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:46:12.874 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:46:12.876 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:46:12.882 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:46:12.882 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:46:12.922 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:46:12.941 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:46:12.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:46:12.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:15.822322', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNFB7t4utGdHQB+kacGG1MooygB2bq5gkX98MYv0oZR/U4fDZRvLpMWa9YLqkT20GF0N9RgYLa7svWNQgJu9jic='} 2024-09-21T06:46:13.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:15.825929', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlvinPxsvtYtEtcxVrOPLHsHRh7YxQuabkYR/LkvdnNiPolx8vce1ZfNuH4OlBKdKWQ8WVn/nlnkwA9ns4ZWy4='} 2024-09-21T06:46:13.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:15.824799', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSBcNHUahVJiV1zNdYY1AhpD4tv56qiyIORFTgO6s2+9yejRf3HQtW3UiXD5eZsbecL/apI7rU1X6tHDzcGyV8='} 2024-09-21T06:46:13.033 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:46:13.039 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:46:13.039 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:46:13.039 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:46:13.039 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:46:13.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4505b94160>, signals=[15]) 2024-09-21T06:46:13.113 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:46:13.120 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:46:13.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T06:46:13.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:46:13.201 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-09-21T06:46:13.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:46:13.275 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T06:46:13.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:46:13.351 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:46:13.358 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-09-21T06:46:13.377 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-09-21T06:46:13.377 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-09-21T06:46:13.435 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-09-21T06:46:13.435 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-09-21T06:46:13.435 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-09-21T06:46:13.435 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:46:13.435 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:46:13.436 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:46:13.437 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-09-21T06:46:13.454 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-09-21T06:46:13.473 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-09-21T06:46:13.473 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:46:13.531 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:46:13.532 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-09-21T06:46:13.546 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-21T06:46:13.565 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-21T06:46:13.565 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-21T06:46:13.623 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-21T06:46:13.623 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-21T06:46:13.623 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-21T06:46:13.623 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:46:13.623 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:46:13.624 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:46:13.624 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-21T06:46:13.646 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:46:13.662 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:46:13.709 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:46:13.710 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:46:13.712 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:46:13.715 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:46:13.731 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:46:13.737 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:46:13.737 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:46:13.769 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:46:13.773 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:46:13.872 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:46:13.948 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:46:13.962 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:46:13.963 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T06:46:13.963 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:46:13.963 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:46:13.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:46:13.980 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-21T06:46:14.038 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:46:14.038 INFO:teuthology.task.kernel:Running kernel on smithi028: 5.14.0-503.el9.x86_64 2024-09-21T06:46:14.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum install -y kernel 2024-09-21T06:46:18.641 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.3 MB 00:02 2024-09-21T06:46:26.059 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 20 MB 00:06 2024-09-21T06:46:32.126 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-21T06:46:34.435 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T06:46:35.264 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T06:46:40.761 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-21T06:46:42.710 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:46:42.710 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:46:42.813 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-09-21T06:46:42.818 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-21T06:46:42.818 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-09-21T06:46:42.818 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-21T06:46:42.818 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-09-21T06:46:42.818 INFO:teuthology.orchestra.run.smithi028.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout:Install 4 Packages 2024-09-21T06:46:42.819 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:46:42.820 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 79 M 2024-09-21T06:46:42.820 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 126 M 2024-09-21T06:46:42.820 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-09-21T06:46:43.521 INFO:teuthology.orchestra.run.smithi028.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-21T06:46:46.788 INFO:teuthology.orchestra.run.smithi028.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-21T06:46:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.6 MB/s | 35 MB 00:04 2024-09-21T06:46:49.597 INFO:teuthology.orchestra.run.smithi028.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.7 MB/s | 29 MB 00:06 2024-09-21T06:46:49.597 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:46:49.597 INFO:teuthology.orchestra.run.smithi028.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-21T06:46:50.307 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-09-21T06:46:50.704 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-09-21T06:46:50.704 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-09-21T06:46:51.705 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-09-21T06:46:51.705 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-09-21T06:46:54.287 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-09-21T06:46:54.950 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:46:55.039 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:46:57.797 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:46:57.933 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:47:03.051 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:47:03.092 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:08.228 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:47.279 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:47.321 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:47.692 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:47.692 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:47:47.692 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:47:47.692 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:47:48.556 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-09-21T06:47:48.880 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:47:49.025 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:47:49.025 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:47:49.025 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:47:49.025 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:47:49.025 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:47:49.025 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:47:49.025 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:47:49.026 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:47:49.084 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:47:49.084 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:47:49.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -qi grub2-tools 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Name : grub2-tools 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Epoch : 1 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Version : 2.06 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Release : 82.el9 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: x86_64 2024-09-21T06:47:49.126 INFO:teuthology.orchestra.run.smithi028.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Group : Unspecified 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Size : 8274670 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:License : GPLv3+ 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Packager : builder@centos.org 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Vendor : CentOS 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Summary : Support tools for GRUB. 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:Description : 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:47:49.127 INFO:teuthology.orchestra.run.smithi028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:47:49.128 INFO:teuthology.orchestra.run.smithi028.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:47:49.128 INFO:teuthology.orchestra.run.smithi028.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:47:49.128 INFO:teuthology.orchestra.run.smithi028.stdout:hardware devices. 2024-09-21T06:47:49.128 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:47:49.128 INFO:teuthology.orchestra.run.smithi028.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:47:49.128 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:47:49.129 INFO:teuthology.task.kernel:Updating grub on smithi028 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:47:49.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:47:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-09-21T06:47:51.118 INFO:teuthology.orchestra.run.smithi028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:47:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-09-21T06:47:51.162 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-21T06:47:51.177 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.unJlynnzv8 2024-09-21T06:47:51.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.unJlynnzv8 2024-09-21T06:47:51.248 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.unJlynnzv8 2024-09-21T06:47:51.394 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.unJlynnzv8 is 6KB 2024-09-21T06:47:51.442 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.unJlynnzv8 2024-09-21T06:47:51.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:47:51.519 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:47:51.519 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:47:51.520 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:47:51.520 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:47:51.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:47:51.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-09-21T06:48:21.672 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:48:21.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:48:21.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:48:40.175 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-21T06:48:49.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:48:49.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:49:07.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-21T06:49:19.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:49:19.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:49:21.071 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-21T06:49:21.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:49:21.495 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:49:21.495 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-21T06:49:21.510 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:49:21.511 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:49:21.511 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:49:21.511 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:49:22.512 DEBUG:teuthology.parallel:result is None 2024-09-21T06:49:22.512 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:49:22.518 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:49:22.518 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:49:22.521 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:49:22.523 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:49:22.542 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:49:22.553 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:49:22.567 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:49:22.567 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:49:22.578 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:49:22.582 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:49:22.809 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:49:22.817 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:49:22.817 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:49:22.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:49:22.834 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:49:22.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:49:22.851 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:49:22.853 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:49:22.877 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:49:22.952 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:22.957 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:22.962 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:22.966 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:22.980 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:23.019 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:49:23.021 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:49:23.029 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:49:23.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:49:23.032 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:49:23.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:49:23.062 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:49:23.070 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:49:23.070 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:49:23.098 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:49:23.101 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:49:23.119 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.193 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.243 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.322 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.367 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:49:23.368 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:49:23.489 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.531 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.585 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.667 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.714 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:49:23.714 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:49:23.782 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:49:23.890 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:49:23.977 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:49:23.977 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:49:24.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-09-21T06:49:24.046 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-09-21T06:49:24.049 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-21T06:49:24.084 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:49:24.089 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:49:24.135 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:49:24.576 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:49:24.583 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:49:24.583 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:49:24.604 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:49:24.613 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:49:24.613 DEBUG:teuthology.orchestra.run.smithi028:> sudo service auditd rotate 2024-09-21T06:49:24.677 INFO:teuthology.orchestra.run.smithi028.stdout:Rotating logs: 2024-09-21T06:49:24.680 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-09-21T06:49:24.751 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-09-21T06:49:24.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-21T06:49:24.807 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-21T06:49:24.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:49:24.808 DEBUG:teuthology.orchestra.run.smithi028:> /usr/sbin/getenforce 2024-09-21T06:49:24.827 INFO:teuthology.orchestra.run.smithi028.stdout:Permissive 2024-09-21T06:49:24.828 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-09-21T06:49:24.861 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-09-21T06:49:24.861 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-21T06:49:24.883 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-21T06:49:24.884 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi028.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:49:24.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:49:24.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:49:24.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:49:24.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:49:24.939 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:49:24.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:49:24.964 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:49:24.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:49:24.995 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:49:25.031 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:49:25.058 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:49:25.066 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T06:49:25.069 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T06:49:25.188 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:49:25.198 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:49:25.199 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi129.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:53:30.641 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-21T06:53:30.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:53:30.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:30.718 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-21T06:53:30.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-21T06:53:30.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T06:53:30.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:30.879 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-21T06:53:30.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-21T06:53:30.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T06:53:30.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:31.037 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-21T06:53:31.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T06:53:31.115 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:53:31.126 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:53:31.126 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:53:31.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:53:31.129 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:53:31.129 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:53:31.131 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:53:31.131 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:53:31.160 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:53:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:53:31.175 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:53:31.178 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:53:31.186 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:53:31.200 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-09-21T06:53:31.200 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:53:31.204 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: ntpd: command not found 2024-09-21T06:53:31.211 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-09-21T06:53:31.216 INFO:teuthology.orchestra.run.smithi028.stdout:506 Cannot talk to daemon 2024-09-21T06:53:31.225 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-21T06:53:31.226 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:53:31.232 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:53:31.238 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-21T06:53:31.240 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:53:31.247 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:53:31.251 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:53:31.265 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:53:31.296 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:53:31.299 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:53:31.300 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-21T06:53:31.300 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.300 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.300 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.300 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.307 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:53:31.310 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:53:31.311 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-09-21T06:53:31.311 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.311 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.311 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.311 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.327 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:53:31.333 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:53:31.341 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:53:31.341 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:53:31.341 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:53:31.341 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:53:31.346 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:53:31.347 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:53:31.347 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:53:31.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:53:31.349 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:53:31.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:53:31.350 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:53:31.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:53:31.496 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:53:31.496 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:53:31.499 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:53:31.499 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:53:31.503 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:53:31.503 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:53:31.605 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:53:31.605 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:53:31.605 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:53:31.610 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:53:31.610 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:53:31.610 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:53:31.616 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:53:31.617 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:53:31.617 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:53:31.632 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:53:31.632 DEBUG:teuthology.orchestra.run.smithi028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:53:31.636 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:53:31.636 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:53:31.643 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:53:31.643 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:53:31.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:53:31.701 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:53:31.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:53:31.775 DEBUG:teuthology.orchestra.run.smithi028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:53:31.776 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:53:31.783 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:53:31.840 INFO:teuthology.orchestra.run.smithi028.stdout:check_obsoletes = 1 2024-09-21T06:53:31.840 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-09-21T06:53:31.841 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum clean all 2024-09-21T06:53:31.842 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-09-21T06:53:31.848 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-21T06:53:31.849 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-21T06:53:32.066 INFO:teuthology.orchestra.run.smithi129.stdout:45 files removed 2024-09-21T06:53:32.073 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-21T06:53:32.093 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:53:32.097 INFO:teuthology.orchestra.run.smithi028.stdout:45 files removed 2024-09-21T06:53:32.100 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:53:32.124 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:53:32.641 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T06:53:32.684 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 274 kB/s | 84 kB 00:00 2024-09-21T06:53:32.701 INFO:teuthology.orchestra.run.smithi028.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T06:53:32.950 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-21T06:53:32.968 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T06:53:33.002 INFO:teuthology.orchestra.run.smithi028.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T06:53:33.234 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T06:53:33.243 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T06:53:33.277 INFO:teuthology.orchestra.run.smithi028.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T06:53:33.710 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T06:53:33.786 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T06:53:35.520 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-21T06:53:36.017 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-21T06:53:37.969 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T06:53:39.728 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-21T06:53:42.087 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-21T06:53:42.411 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T06:53:43.721 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T06:53:44.512 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 19 kB 00:00 2024-09-21T06:53:44.642 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T06:53:45.275 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T06:53:46.295 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-21T06:53:47.829 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-21T06:53:48.750 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T06:53:49.973 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-21T06:53:50.631 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T06:53:52.125 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.125 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.136 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:53:52.137 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.138 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:53:52.139 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.140 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:53:52.143 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.143 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.205 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-21T06:53:52.225 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T06:53:52.225 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-21T06:53:52.225 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:53:52.226 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:53:52.227 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:53:52.228 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:53:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:53:52.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:53:52.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:53:52.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:53:52.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:53:52.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:53:52.237 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:Install 149 Packages 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 228 M 2024-09-21T06:53:52.238 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-21T06:53:52.774 INFO:teuthology.orchestra.run.smithi181.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T06:53:52.785 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.786 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.799 INFO:teuthology.orchestra.run.smithi129.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:53:52.800 INFO:teuthology.orchestra.run.smithi129.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:53:52.801 INFO:teuthology.orchestra.run.smithi129.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:53:52.802 INFO:teuthology.orchestra.run.smithi129.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.804 INFO:teuthology.orchestra.run.smithi129.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:53:52.807 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.808 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:53:52.871 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-21T06:53:52.883 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T06:53:52.883 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:52.884 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:53:52.885 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:53:52.886 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-09-21T06:53:52.887 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:53:52.888 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:53:52.889 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:53:52.890 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:53:52.891 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:53:52.892 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:53:52.893 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:53:52.894 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:53:52.895 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:53:52.896 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:53:52.897 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:Install 149 Packages 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 8 Packages 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 228 M 2024-09-21T06:53:52.898 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-21T06:53:52.958 INFO:teuthology.orchestra.run.smithi181.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T06:53:53.050 INFO:teuthology.orchestra.run.smithi181.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:53:53.133 INFO:teuthology.orchestra.run.smithi181.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:53:53.226 INFO:teuthology.orchestra.run.smithi181.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T06:53:53.317 INFO:teuthology.orchestra.run.smithi181.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 2.3 MB 00:00 2024-09-21T06:53:53.476 INFO:teuthology.orchestra.run.smithi181.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.0 MB 00:00 2024-09-21T06:53:53.524 INFO:teuthology.orchestra.run.smithi129.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-09-21T06:53:53.885 INFO:teuthology.orchestra.run.smithi181.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T06:53:53.925 INFO:teuthology.orchestra.run.smithi129.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.1 MB/s | 873 kB 00:00 2024-09-21T06:53:53.935 INFO:teuthology.orchestra.run.smithi181.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 507 kB/s | 25 kB 00:00 2024-09-21T06:53:54.016 INFO:teuthology.orchestra.run.smithi129.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:53:54.127 INFO:teuthology.orchestra.run.smithi181.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T06:53:54.186 INFO:teuthology.orchestra.run.smithi181.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T06:53:54.244 INFO:teuthology.orchestra.run.smithi181.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 464 kB/s | 27 kB 00:00 2024-09-21T06:53:54.303 INFO:teuthology.orchestra.run.smithi181.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 546 kB/s | 32 kB 00:00 2024-09-21T06:53:54.403 INFO:teuthology.orchestra.run.smithi181.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T06:53:54.465 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T06:53:54.470 INFO:teuthology.orchestra.run.smithi181.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:53:54.537 INFO:teuthology.orchestra.run.smithi181.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T06:53:54.600 INFO:teuthology.orchestra.run.smithi129.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.9 MB/s | 2.3 MB 00:00 2024-09-21T06:53:54.620 INFO:teuthology.orchestra.run.smithi181.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.0 MB/s | 507 kB 00:00 2024-09-21T06:53:54.787 INFO:teuthology.orchestra.run.smithi181.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T06:53:54.792 INFO:teuthology.orchestra.run.smithi129.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.9 MB/s | 1.5 MB 00:00 2024-09-21T06:53:54.838 INFO:teuthology.orchestra.run.smithi181.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 907 kB/s | 45 kB 00:00 2024-09-21T06:53:54.930 INFO:teuthology.orchestra.run.smithi181.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T06:53:55.046 INFO:teuthology.orchestra.run.smithi181.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T06:53:55.072 INFO:teuthology.orchestra.run.smithi181.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.1 MB/s | 161 kB 00:00 2024-09-21T06:53:55.097 INFO:teuthology.orchestra.run.smithi181.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T06:53:55.131 INFO:teuthology.orchestra.run.smithi181.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T06:53:55.156 INFO:teuthology.orchestra.run.smithi181.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:53:55.181 INFO:teuthology.orchestra.run.smithi181.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:53:55.232 INFO:teuthology.orchestra.run.smithi181.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:53:55.234 INFO:teuthology.orchestra.run.smithi129.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-21T06:53:55.298 INFO:teuthology.orchestra.run.smithi181.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 515 kB/s | 34 kB 00:00 2024-09-21T06:53:55.357 INFO:teuthology.orchestra.run.smithi181.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T06:53:55.392 INFO:teuthology.orchestra.run.smithi181.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T06:53:55.759 INFO:teuthology.orchestra.run.smithi181.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T06:53:55.826 INFO:teuthology.orchestra.run.smithi181.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:53:55.901 INFO:teuthology.orchestra.run.smithi181.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 661 kB/s | 49 kB 00:00 2024-09-21T06:53:55.977 INFO:teuthology.orchestra.run.smithi181.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 219 kB/s | 16 kB 00:00 2024-09-21T06:53:56.060 INFO:teuthology.orchestra.run.smithi129.stdout:(7/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 22 MB/s | 18 MB 00:00 2024-09-21T06:53:56.085 INFO:teuthology.orchestra.run.smithi181.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T06:53:56.111 INFO:teuthology.orchestra.run.smithi181.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.1 MB/s | 285 kB 00:00 2024-09-21T06:53:56.194 INFO:teuthology.orchestra.run.smithi181.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 221 kB/s | 18 kB 00:00 2024-09-21T06:53:56.228 INFO:teuthology.orchestra.run.smithi181.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.4 MB/s | 784 kB 00:00 2024-09-21T06:53:56.396 INFO:teuthology.orchestra.run.smithi181.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 14 MB/s | 14 MB 00:01 2024-09-21T06:53:56.412 INFO:teuthology.orchestra.run.smithi181.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 367 kB/s | 80 kB 00:00 2024-09-21T06:53:56.460 INFO:teuthology.orchestra.run.smithi129.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 26 MB/s | 10 MB 00:00 2024-09-21T06:53:56.487 INFO:teuthology.orchestra.run.smithi181.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-21T06:53:56.502 INFO:teuthology.orchestra.run.smithi129.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 605 kB/s | 25 kB 00:00 2024-09-21T06:53:56.521 INFO:teuthology.orchestra.run.smithi181.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T06:53:56.555 INFO:teuthology.orchestra.run.smithi181.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T06:53:56.571 INFO:teuthology.orchestra.run.smithi181.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:53:56.596 INFO:teuthology.orchestra.run.smithi181.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-21T06:53:56.622 INFO:teuthology.orchestra.run.smithi181.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:53:56.647 INFO:teuthology.orchestra.run.smithi181.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T06:53:56.681 INFO:teuthology.orchestra.run.smithi181.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-21T06:53:56.778 INFO:teuthology.orchestra.run.smithi028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:56.779 INFO:teuthology.orchestra.run.smithi028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:53:56.793 INFO:teuthology.orchestra.run.smithi028.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:53:56.794 INFO:teuthology.orchestra.run.smithi028.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:53:56.795 INFO:teuthology.orchestra.run.smithi028.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:53:56.796 INFO:teuthology.orchestra.run.smithi028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:53:56.798 INFO:teuthology.orchestra.run.smithi028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:53:56.801 INFO:teuthology.orchestra.run.smithi028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:53:56.802 INFO:teuthology.orchestra.run.smithi028.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:53:56.823 INFO:teuthology.orchestra.run.smithi181.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-21T06:53:56.871 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-09-21T06:53:56.873 INFO:teuthology.orchestra.run.smithi181.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T06:53:56.890 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-09-21T06:53:56.890 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-09-21T06:53:56.890 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:53:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:53:56.892 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrading: 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:53:56.893 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:53:56.894 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:53:56.895 INFO:teuthology.orchestra.run.smithi028.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:53:56.896 INFO:teuthology.orchestra.run.smithi028.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:53:56.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:53:56.898 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:53:56.899 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:53:56.900 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:53:56.901 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout:Installing weak dependencies: 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:53:56.902 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:Install 149 Packages 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrade 8 Packages 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 228 M 2024-09-21T06:53:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-09-21T06:53:56.906 INFO:teuthology.orchestra.run.smithi181.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-21T06:53:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-21T06:53:56.990 INFO:teuthology.orchestra.run.smithi181.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-21T06:53:57.016 INFO:teuthology.orchestra.run.smithi181.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-21T06:53:57.050 INFO:teuthology.orchestra.run.smithi181.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-21T06:53:57.075 INFO:teuthology.orchestra.run.smithi181.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-21T06:53:57.125 INFO:teuthology.orchestra.run.smithi181.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:53:57.150 INFO:teuthology.orchestra.run.smithi181.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T06:53:57.227 INFO:teuthology.orchestra.run.smithi129.stdout:(10/157): ceph-base-19.3.0-5120.g18432218.el9.x 1.4 MB/s | 5.5 MB 00:03 2024-09-21T06:53:57.300 INFO:teuthology.orchestra.run.smithi181.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-21T06:53:57.308 INFO:teuthology.orchestra.run.smithi028.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 44 kB/s | 6.6 kB 00:00 2024-09-21T06:53:57.325 INFO:teuthology.orchestra.run.smithi181.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-09-21T06:53:57.376 INFO:teuthology.orchestra.run.smithi181.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-21T06:53:57.426 INFO:teuthology.orchestra.run.smithi181.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-21T06:53:57.485 INFO:teuthology.orchestra.run.smithi181.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-21T06:53:57.491 INFO:teuthology.orchestra.run.smithi028.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T06:53:57.510 INFO:teuthology.orchestra.run.smithi181.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T06:53:57.552 INFO:teuthology.orchestra.run.smithi181.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 924 kB/s | 38 kB 00:00 2024-09-21T06:53:57.566 INFO:teuthology.orchestra.run.smithi028.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T06:53:57.577 INFO:teuthology.orchestra.run.smithi181.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T06:53:57.619 INFO:teuthology.orchestra.run.smithi129.stdout:(11/157): ceph-test-19.3.0-5120.g18432218.el9.x 36 MB/s | 40 MB 00:01 2024-09-21T06:53:57.644 INFO:teuthology.orchestra.run.smithi181.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-09-21T06:53:57.645 INFO:teuthology.orchestra.run.smithi129.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 541 kB/s | 226 kB 00:00 2024-09-21T06:53:57.650 INFO:teuthology.orchestra.run.smithi028.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:53:57.670 INFO:teuthology.orchestra.run.smithi129.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 540 kB/s | 27 kB 00:00 2024-09-21T06:53:57.703 INFO:teuthology.orchestra.run.smithi129.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 543 kB/s | 32 kB 00:00 2024-09-21T06:53:57.726 INFO:teuthology.orchestra.run.smithi028.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 14 MB/s | 2.3 MB 00:00 2024-09-21T06:53:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T06:53:57.776 INFO:teuthology.orchestra.run.smithi028.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T06:53:57.812 INFO:teuthology.orchestra.run.smithi129.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.4 MB/s | 158 kB 00:00 2024-09-21T06:53:57.837 INFO:teuthology.orchestra.run.smithi129.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T06:53:57.928 INFO:teuthology.orchestra.run.smithi181.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-21T06:53:58.103 INFO:teuthology.orchestra.run.smithi181.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T06:53:58.134 INFO:teuthology.orchestra.run.smithi028.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T06:53:58.153 INFO:teuthology.orchestra.run.smithi181.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-21T06:53:58.154 INFO:teuthology.orchestra.run.smithi129.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 1.4 MB/s | 507 kB 00:00 2024-09-21T06:53:58.263 INFO:teuthology.orchestra.run.smithi129.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 417 kB/s | 45 kB 00:00 2024-09-21T06:53:58.338 INFO:teuthology.orchestra.run.smithi129.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.3 MB 00:00 2024-09-21T06:53:58.370 INFO:teuthology.orchestra.run.smithi181.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.0 MB/s | 4.9 MB 00:00 2024-09-21T06:53:58.422 INFO:teuthology.orchestra.run.smithi129.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 936 kB/s | 148 kB 00:00 2024-09-21T06:53:58.447 INFO:teuthology.orchestra.run.smithi129.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T06:53:58.462 INFO:teuthology.orchestra.run.smithi181.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-09-21T06:53:58.513 INFO:teuthology.orchestra.run.smithi181.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T06:53:58.531 INFO:teuthology.orchestra.run.smithi129.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T06:53:58.589 INFO:teuthology.orchestra.run.smithi129.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:53:58.596 INFO:teuthology.orchestra.run.smithi181.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-21T06:53:58.614 INFO:teuthology.orchestra.run.smithi129.stdout:(25/157): python3-rados-19.3.0-5120.g18432218.e 1.6 MB/s | 321 kB 00:00 2024-09-21T06:53:58.640 INFO:teuthology.orchestra.run.smithi129.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:53:58.651 INFO:teuthology.orchestra.run.smithi028.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 13 MB/s | 20 MB 00:01 2024-09-21T06:53:58.654 INFO:teuthology.orchestra.run.smithi181.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T06:53:58.690 INFO:teuthology.orchestra.run.smithi129.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:53:58.701 INFO:teuthology.orchestra.run.smithi028.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T06:53:58.738 INFO:teuthology.orchestra.run.smithi181.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T06:53:58.740 INFO:teuthology.orchestra.run.smithi129.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 681 kB/s | 34 kB 00:00 2024-09-21T06:53:58.791 INFO:teuthology.orchestra.run.smithi129.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:53:58.822 INFO:teuthology.orchestra.run.smithi181.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T06:53:58.880 INFO:teuthology.orchestra.run.smithi181.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-21T06:53:58.885 INFO:teuthology.orchestra.run.smithi028.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T06:53:58.939 INFO:teuthology.orchestra.run.smithi181.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-21T06:53:58.997 INFO:teuthology.orchestra.run.smithi181.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T06:53:59.002 INFO:teuthology.orchestra.run.smithi028.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T06:53:59.027 INFO:teuthology.orchestra.run.smithi028.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T06:53:59.061 INFO:teuthology.orchestra.run.smithi028.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 464 kB/s | 27 kB 00:00 2024-09-21T06:53:59.088 INFO:teuthology.orchestra.run.smithi028.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 521 kB/s | 32 kB 00:00 2024-09-21T06:53:59.089 INFO:teuthology.orchestra.run.smithi181.stdout:(81/157): postgresql-server-13.16-1.el9.x86_64. 6.2 MB/s | 5.8 MB 00:00 2024-09-21T06:53:59.115 INFO:teuthology.orchestra.run.smithi181.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-21T06:53:59.147 INFO:teuthology.orchestra.run.smithi028.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.7 MB/s | 766 kB 00:00 2024-09-21T06:53:59.180 INFO:teuthology.orchestra.run.smithi028.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.7 MB/s | 158 kB 00:00 2024-09-21T06:53:59.198 INFO:teuthology.orchestra.run.smithi181.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-21T06:53:59.222 INFO:teuthology.orchestra.run.smithi028.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T06:53:59.264 INFO:teuthology.orchestra.run.smithi028.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.9 MB/s | 507 kB 00:00 2024-09-21T06:53:59.275 INFO:teuthology.orchestra.run.smithi181.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-21T06:53:59.324 INFO:teuthology.orchestra.run.smithi181.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:53:59.331 INFO:teuthology.orchestra.run.smithi028.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 676 kB/s | 45 kB 00:00 2024-09-21T06:53:59.358 INFO:teuthology.orchestra.run.smithi129.stdout:(30/157): ceph-mgr-dashboard-19.3.0-5120.g18432 25 MB/s | 14 MB 00:00 2024-09-21T06:53:59.374 INFO:teuthology.orchestra.run.smithi181.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T06:53:59.398 INFO:teuthology.orchestra.run.smithi028.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:53:59.458 INFO:teuthology.orchestra.run.smithi181.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-21T06:53:59.498 INFO:teuthology.orchestra.run.smithi028.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.6 MB/s | 161 kB 00:00 2024-09-21T06:53:59.516 INFO:teuthology.orchestra.run.smithi181.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T06:53:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.4 MB/s | 6.0 MB 00:01 2024-09-21T06:53:59.640 INFO:teuthology.orchestra.run.smithi028.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T06:53:59.642 INFO:teuthology.orchestra.run.smithi181.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-21T06:53:59.676 INFO:teuthology.orchestra.run.smithi181.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-21T06:53:59.701 INFO:teuthology.orchestra.run.smithi181.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-21T06:53:59.733 INFO:teuthology.orchestra.run.smithi028.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 1.3 MB/s | 321 kB 00:00 2024-09-21T06:53:59.734 INFO:teuthology.orchestra.run.smithi129.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-21T06:53:59.751 INFO:teuthology.orchestra.run.smithi181.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-21T06:53:59.783 INFO:teuthology.orchestra.run.smithi129.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T06:53:59.808 INFO:teuthology.orchestra.run.smithi028.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 1.8 MB/s | 307 kB 00:00 2024-09-21T06:53:59.810 INFO:teuthology.orchestra.run.smithi181.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 761 kB/s | 44 kB 00:00 2024-09-21T06:53:59.825 INFO:teuthology.orchestra.run.smithi129.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.2 MB/s | 49 kB 00:00 2024-09-21T06:53:59.833 INFO:teuthology.orchestra.run.smithi028.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.0 MB/s | 99 kB 00:00 2024-09-21T06:53:59.858 INFO:teuthology.orchestra.run.smithi028.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:53:59.877 INFO:teuthology.orchestra.run.smithi181.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.5 MB/s | 5.1 MB 00:00 2024-09-21T06:53:59.884 INFO:teuthology.orchestra.run.smithi129.stdout:(34/157): rbd-mirror-19.3.0-5120.g18432218.el9. 2.4 MB/s | 3.1 MB 00:01 2024-09-21T06:53:59.902 INFO:teuthology.orchestra.run.smithi181.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T06:53:59.909 INFO:teuthology.orchestra.run.smithi129.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 196 kB/s | 16 kB 00:00 2024-09-21T06:53:59.917 INFO:teuthology.orchestra.run.smithi028.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T06:53:59.927 INFO:teuthology.orchestra.run.smithi181.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-21T06:53:59.953 INFO:teuthology.orchestra.run.smithi181.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T06:53:59.968 INFO:teuthology.orchestra.run.smithi129.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T06:53:59.984 INFO:teuthology.orchestra.run.smithi028.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T06:54:00.009 INFO:teuthology.orchestra.run.smithi028.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T06:54:00.010 INFO:teuthology.orchestra.run.smithi129.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 441 kB/s | 18 kB 00:00 2024-09-21T06:54:00.028 INFO:teuthology.orchestra.run.smithi181.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 772 kB/s | 58 kB 00:00 2024-09-21T06:54:00.036 INFO:teuthology.orchestra.run.smithi129.stdout:(38/157): ceph-volume-19.3.0-5120.g18432218.el9 1.8 MB/s | 285 kB 00:00 2024-09-21T06:54:00.043 INFO:teuthology.orchestra.run.smithi028.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T06:54:00.053 INFO:teuthology.orchestra.run.smithi181.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T06:54:00.087 INFO:teuthology.orchestra.run.smithi181.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T06:54:00.112 INFO:teuthology.orchestra.run.smithi181.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T06:54:00.137 INFO:teuthology.orchestra.run.smithi181.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T06:54:00.163 INFO:teuthology.orchestra.run.smithi181.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-09-21T06:54:00.202 INFO:teuthology.orchestra.run.smithi129.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-21T06:54:00.213 INFO:teuthology.orchestra.run.smithi181.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:54:00.247 INFO:teuthology.orchestra.run.smithi181.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:54:00.263 INFO:teuthology.orchestra.run.smithi181.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T06:54:00.286 INFO:teuthology.orchestra.run.smithi129.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T06:54:00.297 INFO:teuthology.orchestra.run.smithi181.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-09-21T06:54:00.311 INFO:teuthology.orchestra.run.smithi129.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-21T06:54:00.339 INFO:teuthology.orchestra.run.smithi181.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-21T06:54:00.345 INFO:teuthology.orchestra.run.smithi129.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T06:54:00.356 INFO:teuthology.orchestra.run.smithi181.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T06:54:00.382 INFO:teuthology.orchestra.run.smithi181.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T06:54:00.404 INFO:teuthology.orchestra.run.smithi129.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-21T06:54:00.406 INFO:teuthology.orchestra.run.smithi181.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:54:00.429 INFO:teuthology.orchestra.run.smithi129.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-21T06:54:00.455 INFO:teuthology.orchestra.run.smithi129.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:54:00.468 INFO:teuthology.orchestra.run.smithi028.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-21T06:54:00.498 INFO:teuthology.orchestra.run.smithi181.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-21T06:54:00.513 INFO:teuthology.orchestra.run.smithi129.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T06:54:00.535 INFO:teuthology.orchestra.run.smithi028.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:54:00.540 INFO:teuthology.orchestra.run.smithi181.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-21T06:54:00.557 INFO:teuthology.orchestra.run.smithi181.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T06:54:00.574 INFO:teuthology.orchestra.run.smithi181.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:54:00.591 INFO:teuthology.orchestra.run.smithi181.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 854 kB/s | 14 kB 00:00 2024-09-21T06:54:00.593 INFO:teuthology.orchestra.run.smithi028.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 847 kB/s | 49 kB 00:00 2024-09-21T06:54:00.625 INFO:teuthology.orchestra.run.smithi181.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T06:54:00.650 INFO:teuthology.orchestra.run.smithi181.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T06:54:00.677 INFO:teuthology.orchestra.run.smithi028.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 197 kB/s | 16 kB 00:00 2024-09-21T06:54:00.684 INFO:teuthology.orchestra.run.smithi181.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T06:54:00.709 INFO:teuthology.orchestra.run.smithi181.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T06:54:00.735 INFO:teuthology.orchestra.run.smithi181.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:54:00.760 INFO:teuthology.orchestra.run.smithi181.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:54:00.785 INFO:teuthology.orchestra.run.smithi181.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T06:54:00.811 INFO:teuthology.orchestra.run.smithi181.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-21T06:54:00.836 INFO:teuthology.orchestra.run.smithi181.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-21T06:54:00.861 INFO:teuthology.orchestra.run.smithi181.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T06:54:00.886 INFO:teuthology.orchestra.run.smithi181.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T06:54:00.953 INFO:teuthology.orchestra.run.smithi181.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T06:54:00.979 INFO:teuthology.orchestra.run.smithi181.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:54:01.012 INFO:teuthology.orchestra.run.smithi181.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-21T06:54:01.019 INFO:teuthology.orchestra.run.smithi028.stdout:(35/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T06:54:01.037 INFO:teuthology.orchestra.run.smithi181.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T06:54:01.044 INFO:teuthology.orchestra.run.smithi028.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 777 kB/s | 285 kB 00:00 2024-09-21T06:54:01.063 INFO:teuthology.orchestra.run.smithi181.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T06:54:01.088 INFO:teuthology.orchestra.run.smithi181.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T06:54:01.113 INFO:teuthology.orchestra.run.smithi181.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:54:01.139 INFO:teuthology.orchestra.run.smithi181.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T06:54:01.164 INFO:teuthology.orchestra.run.smithi181.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T06:54:01.189 INFO:teuthology.orchestra.run.smithi181.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T06:54:01.203 INFO:teuthology.orchestra.run.smithi028.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:54:01.214 INFO:teuthology.orchestra.run.smithi181.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:54:01.228 INFO:teuthology.orchestra.run.smithi028.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 100 kB/s | 18 kB 00:00 2024-09-21T06:54:01.239 INFO:teuthology.orchestra.run.smithi181.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:54:01.262 INFO:teuthology.orchestra.run.smithi028.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.2 MB/s | 784 kB 00:00 2024-09-21T06:54:01.265 INFO:teuthology.orchestra.run.smithi181.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T06:54:01.290 INFO:teuthology.orchestra.run.smithi181.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:54:01.315 INFO:teuthology.orchestra.run.smithi181.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:54:01.330 INFO:teuthology.orchestra.run.smithi129.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 844 kB/s | 689 kB 00:00 2024-09-21T06:54:01.341 INFO:teuthology.orchestra.run.smithi181.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:54:01.366 INFO:teuthology.orchestra.run.smithi181.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-21T06:54:01.370 INFO:teuthology.orchestra.run.smithi028.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-21T06:54:01.391 INFO:teuthology.orchestra.run.smithi181.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T06:54:01.425 INFO:teuthology.orchestra.run.smithi181.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T06:54:01.454 INFO:teuthology.orchestra.run.smithi028.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2024-09-21T06:54:01.479 INFO:teuthology.orchestra.run.smithi028.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T06:54:01.483 INFO:teuthology.orchestra.run.smithi181.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T06:54:01.546 INFO:teuthology.orchestra.run.smithi028.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-21T06:54:01.547 INFO:teuthology.orchestra.run.smithi129.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 943 kB 00:00 2024-09-21T06:54:01.596 INFO:teuthology.orchestra.run.smithi028.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:54:01.638 INFO:teuthology.orchestra.run.smithi028.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 669 kB/s | 106 kB 00:00 2024-09-21T06:54:01.664 INFO:teuthology.orchestra.run.smithi028.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-21T06:54:01.692 INFO:teuthology.orchestra.run.smithi181.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T06:54:01.722 INFO:teuthology.orchestra.run.smithi028.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T06:54:01.768 INFO:teuthology.orchestra.run.smithi181.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T06:54:01.772 INFO:teuthology.orchestra.run.smithi028.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-21T06:54:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:(49/157): ceph-common-19.3.0-5120.g18432218.el9 2.4 MB/s | 20 MB 00:08 2024-09-21T06:54:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 419 kB/s | 107 kB 00:00 2024-09-21T06:54:01.860 INFO:teuthology.orchestra.run.smithi181.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-21T06:54:01.893 INFO:teuthology.orchestra.run.smithi181.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-21T06:54:01.928 INFO:teuthology.orchestra.run.smithi129.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-09-21T06:54:01.952 INFO:teuthology.orchestra.run.smithi181.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.8 MB/s | 1.8 MB 00:00 2024-09-21T06:54:01.977 INFO:teuthology.orchestra.run.smithi181.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T06:54:02.019 INFO:teuthology.orchestra.run.smithi181.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T06:54:02.044 INFO:teuthology.orchestra.run.smithi129.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-21T06:54:02.070 INFO:teuthology.orchestra.run.smithi129.stdout:(53/157): elfutils-libelf-devel-0.191-4.el9.x86 74 kB/s | 22 kB 00:00 2024-09-21T06:54:02.078 INFO:teuthology.orchestra.run.smithi181.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T06:54:02.187 INFO:teuthology.orchestra.run.smithi129.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-21T06:54:02.295 INFO:teuthology.orchestra.run.smithi129.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-21T06:54:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:(56/157): python3-requests-2.25.1-8.el9.noarch. 64 kB/s | 125 kB 00:01 2024-09-21T06:54:02.389 INFO:teuthology.orchestra.run.smithi028.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 173 kB/s | 107 kB 00:00 2024-09-21T06:54:02.578 INFO:teuthology.orchestra.run.smithi181.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-21T06:54:02.579 INFO:teuthology.orchestra.run.smithi129.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 601 kB/s | 171 kB 00:00 2024-09-21T06:54:02.584 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:54:02.584 INFO:teuthology.orchestra.run.smithi181.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T06:54:02.696 INFO:teuthology.orchestra.run.smithi129.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-09-21T06:54:02.838 INFO:teuthology.orchestra.run.smithi129.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.8 MB/s | 3.0 MB 00:00 2024-09-21T06:54:02.938 INFO:teuthology.orchestra.run.smithi129.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 291 kB/s | 160 kB 00:00 2024-09-21T06:54:02.989 INFO:teuthology.orchestra.run.smithi129.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-21T06:54:03.047 INFO:teuthology.orchestra.run.smithi129.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-21T06:54:03.098 INFO:teuthology.orchestra.run.smithi129.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T06:54:03.215 INFO:teuthology.orchestra.run.smithi129.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T06:54:03.331 INFO:teuthology.orchestra.run.smithi129.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 330 kB/s | 38 kB 00:00 2024-09-21T06:54:03.357 INFO:teuthology.orchestra.run.smithi129.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 945 kB/s | 292 kB 00:00 2024-09-21T06:54:03.799 INFO:teuthology.orchestra.run.smithi129.stdout:(67/157): libtool-2.4.6-46.el9.x86_64.rpm 605 kB/s | 581 kB 00:00 2024-09-21T06:54:03.820 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-21T06:54:03.973 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-21T06:54:03.973 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-21T06:54:04.365 INFO:teuthology.orchestra.run.smithi028.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 11 kB/s | 22 kB 00:01 2024-09-21T06:54:04.407 INFO:teuthology.orchestra.run.smithi129.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-21T06:54:04.648 INFO:teuthology.orchestra.run.smithi028.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 231 kB/s | 689 kB 00:02 2024-09-21T06:54:04.698 INFO:teuthology.orchestra.run.smithi028.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-21T06:54:04.732 INFO:teuthology.orchestra.run.smithi028.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 313 kB/s | 943 kB 00:03 2024-09-21T06:54:05.741 INFO:teuthology.orchestra.run.smithi129.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 682 kB/s | 910 kB 00:01 2024-09-21T06:54:05.795 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-21T06:54:05.795 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-21T06:54:06.024 INFO:teuthology.orchestra.run.smithi129.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 485 kB/s | 137 kB 00:00 2024-09-21T06:54:06.158 INFO:teuthology.orchestra.run.smithi129.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 688 kB/s | 1.6 MB 00:02 2024-09-21T06:54:06.207 INFO:teuthology.orchestra.run.smithi028.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 12 kB/s | 18 kB 00:01 2024-09-21T06:54:06.299 INFO:teuthology.orchestra.run.smithi028.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 162 kB/s | 313 kB 00:01 2024-09-21T06:54:06.308 INFO:teuthology.orchestra.run.smithi129.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-09-21T06:54:06.342 INFO:teuthology.orchestra.run.smithi129.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-21T06:54:06.426 INFO:teuthology.orchestra.run.smithi129.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 749 kB/s | 87 kB 00:00 2024-09-21T06:54:06.499 INFO:teuthology.orchestra.run.smithi028.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 38 kB/s | 11 kB 00:00 2024-09-21T06:54:06.534 INFO:teuthology.orchestra.run.smithi129.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-21T06:54:06.591 INFO:teuthology.orchestra.run.smithi028.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 585 kB/s | 171 kB 00:00 2024-09-21T06:54:06.635 INFO:teuthology.orchestra.run.smithi129.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-21T06:54:06.641 INFO:teuthology.orchestra.run.smithi028.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-21T06:54:06.667 INFO:teuthology.orchestra.run.smithi028.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-09-21T06:54:06.752 INFO:teuthology.orchestra.run.smithi129.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-21T06:54:06.777 INFO:teuthology.orchestra.run.smithi129.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-21T06:54:06.860 INFO:teuthology.orchestra.run.smithi129.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-21T06:54:06.886 INFO:teuthology.orchestra.run.smithi129.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-21T06:54:06.978 INFO:teuthology.orchestra.run.smithi129.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T06:54:06.995 INFO:teuthology.orchestra.run.smithi129.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-21T06:54:07.112 INFO:teuthology.orchestra.run.smithi129.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T06:54:07.229 INFO:teuthology.orchestra.run.smithi129.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T06:54:07.337 INFO:teuthology.orchestra.run.smithi129.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 713 kB/s | 77 kB 00:00 2024-09-21T06:54:07.446 INFO:teuthology.orchestra.run.smithi129.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-21T06:54:07.563 INFO:teuthology.orchestra.run.smithi129.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T06:54:07.680 INFO:teuthology.orchestra.run.smithi129.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T06:54:07.797 INFO:teuthology.orchestra.run.smithi129.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T06:54:07.914 INFO:teuthology.orchestra.run.smithi129.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-09-21T06:54:08.022 INFO:teuthology.orchestra.run.smithi129.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-21T06:54:08.698 INFO:teuthology.orchestra.run.smithi129.stdout:(92/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T06:54:08.798 INFO:teuthology.orchestra.run.smithi129.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-09-21T06:54:08.823 INFO:teuthology.orchestra.run.smithi129.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-09-21T06:54:08.915 INFO:teuthology.orchestra.run.smithi129.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-21T06:54:08.940 INFO:teuthology.orchestra.run.smithi129.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T06:54:09.024 INFO:teuthology.orchestra.run.smithi129.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 330 kB/s | 36 kB 00:00 2024-09-21T06:54:09.050 INFO:teuthology.orchestra.run.smithi129.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-21T06:54:09.150 INFO:teuthology.orchestra.run.smithi129.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T06:54:09.175 INFO:teuthology.orchestra.run.smithi129.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 461 kB/s | 58 kB 00:00 2024-09-21T06:54:09.259 INFO:teuthology.orchestra.run.smithi129.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 883 kB/s | 96 kB 00:00 2024-09-21T06:54:09.284 INFO:teuthology.orchestra.run.smithi129.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 585 kB/s | 64 kB 00:00 2024-09-21T06:54:09.368 INFO:teuthology.orchestra.run.smithi129.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-21T06:54:09.393 INFO:teuthology.orchestra.run.smithi129.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-21T06:54:09.443 INFO:teuthology.orchestra.run.smithi129.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:54:09.477 INFO:teuthology.orchestra.run.smithi129.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:54:09.502 INFO:teuthology.orchestra.run.smithi129.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-21T06:54:09.619 INFO:teuthology.orchestra.run.smithi129.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:54:09.728 INFO:teuthology.orchestra.run.smithi129.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-21T06:54:09.754 INFO:teuthology.orchestra.run.smithi129.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:54:09.779 INFO:teuthology.orchestra.run.smithi129.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-21T06:54:09.804 INFO:teuthology.orchestra.run.smithi129.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T06:54:09.863 INFO:teuthology.orchestra.run.smithi129.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T06:54:09.888 INFO:teuthology.orchestra.run.smithi129.stdout:(114/157): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-21T06:54:09.905 INFO:teuthology.orchestra.run.smithi129.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T06:54:09.939 INFO:teuthology.orchestra.run.smithi129.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-21T06:54:09.956 INFO:teuthology.orchestra.run.smithi129.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T06:54:09.973 INFO:teuthology.orchestra.run.smithi129.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-21T06:54:09.998 INFO:teuthology.orchestra.run.smithi129.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T06:54:10.023 INFO:teuthology.orchestra.run.smithi129.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T06:54:10.048 INFO:teuthology.orchestra.run.smithi129.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T06:54:10.073 INFO:teuthology.orchestra.run.smithi129.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:54:10.099 INFO:teuthology.orchestra.run.smithi129.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T06:54:10.124 INFO:teuthology.orchestra.run.smithi129.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T06:54:10.149 INFO:teuthology.orchestra.run.smithi129.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T06:54:10.175 INFO:teuthology.orchestra.run.smithi129.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 918 kB/s | 23 kB 00:00 2024-09-21T06:54:10.200 INFO:teuthology.orchestra.run.smithi129.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-21T06:54:10.226 INFO:teuthology.orchestra.run.smithi129.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-21T06:54:10.284 INFO:teuthology.orchestra.run.smithi129.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.6 MB/s | 2.0 MB 00:00 2024-09-21T06:54:10.310 INFO:teuthology.orchestra.run.smithi129.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:54:10.335 INFO:teuthology.orchestra.run.smithi129.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:54:10.360 INFO:teuthology.orchestra.run.smithi129.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:54:10.402 INFO:teuthology.orchestra.run.smithi129.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T06:54:10.427 INFO:teuthology.orchestra.run.smithi129.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T06:54:10.453 INFO:teuthology.orchestra.run.smithi129.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-21T06:54:10.478 INFO:teuthology.orchestra.run.smithi129.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-21T06:54:10.503 INFO:teuthology.orchestra.run.smithi129.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-21T06:54:10.529 INFO:teuthology.orchestra.run.smithi129.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T06:54:10.554 INFO:teuthology.orchestra.run.smithi129.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:54:10.579 INFO:teuthology.orchestra.run.smithi129.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:54:10.604 INFO:teuthology.orchestra.run.smithi129.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T06:54:10.675 INFO:teuthology.orchestra.run.smithi028.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 164 kB/s | 662 kB 00:04 2024-09-21T06:54:10.680 INFO:teuthology.orchestra.run.smithi129.stdout:(142/157): postgresql-server-13.16-1.el9.x86_64 1.2 MB/s | 5.8 MB 00:04 2024-09-21T06:54:10.713 INFO:teuthology.orchestra.run.smithi129.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 687 kB/s | 74 kB 00:00 2024-09-21T06:54:10.739 INFO:teuthology.orchestra.run.smithi129.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T06:54:10.764 INFO:teuthology.orchestra.run.smithi129.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-21T06:54:10.789 INFO:teuthology.orchestra.run.smithi129.stdout:(146/157): python3-websocket-client-1.2.3-2.el9 823 kB/s | 90 kB 00:00 2024-09-21T06:54:10.814 INFO:teuthology.orchestra.run.smithi129.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-21T06:54:10.840 INFO:teuthology.orchestra.run.smithi129.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T06:54:10.890 INFO:teuthology.orchestra.run.smithi129.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:54:11.357 INFO:teuthology.orchestra.run.smithi129.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.1 MB/s | 3.2 MB 00:00 2024-09-21T06:54:11.516 INFO:teuthology.orchestra.run.smithi129.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 5.0 MB/s | 3.4 MB 00:00 2024-09-21T06:54:11.657 INFO:teuthology.orchestra.run.smithi129.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 289 kB/s | 41 kB 00:00 2024-09-21T06:54:11.966 INFO:teuthology.orchestra.run.smithi129.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-21T06:54:12.145 INFO:teuthology.orchestra.run.smithi129.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 7.6 MB/s | 1.4 MB 00:00 2024-09-21T06:54:12.320 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-21T06:54:12.456 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:54:12.495 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:54:12.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:54:12.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:54:12.641 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:54:12.683 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:54:12.708 INFO:teuthology.orchestra.run.smithi028.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 12 kB/s | 24 kB 00:02 2024-09-21T06:54:12.742 INFO:teuthology.orchestra.run.smithi028.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 96 kB/s | 581 kB 00:06 2024-09-21T06:54:13.016 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:54:13.150 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:13.192 INFO:teuthology.orchestra.run.smithi028.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 98 kB/s | 47 kB 00:00 2024-09-21T06:54:13.276 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:13.301 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:13.350 INFO:teuthology.orchestra.run.smithi129.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 929 kB/s | 1.8 MB 00:01 2024-09-21T06:54:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:54:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:54:13.599 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:54:13.653 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:54:13.681 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:13.784 INFO:teuthology.orchestra.run.smithi028.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 281 kB/s | 292 kB 00:01 2024-09-21T06:54:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:13.792 INFO:teuthology.orchestra.run.smithi129.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 117 kB/s | 249 kB 00:02 2024-09-21T06:54:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:13.834 INFO:teuthology.orchestra.run.smithi028.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-21T06:54:13.868 INFO:teuthology.orchestra.run.smithi028.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 279 kB/s | 188 kB 00:00 2024-09-21T06:54:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:13.900 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:13.920 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:14.035 INFO:teuthology.orchestra.run.smithi028.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 328 kB/s | 3.0 MB 00:09 2024-09-21T06:54:14.093 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:14.239 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:14.373 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:54:14.385 INFO:teuthology.orchestra.run.smithi028.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-09-21T06:54:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:14.541 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:54:14.935 INFO:teuthology.orchestra.run.smithi028.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 1.6 MB/s | 910 kB 00:00 2024-09-21T06:54:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:54:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:54:15.019 INFO:teuthology.orchestra.run.smithi028.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T06:54:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:54:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:54:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:54:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:54:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:54:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:54:15.278 INFO:teuthology.orchestra.run.smithi028.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-09-21T06:54:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:54:15.350 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:54:15.381 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:54:15.386 INFO:teuthology.orchestra.run.smithi028.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-09-21T06:54:15.416 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:54:15.436 INFO:teuthology.orchestra.run.smithi028.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T06:54:15.478 INFO:teuthology.orchestra.run.smithi028.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-21T06:54:15.499 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:54:15.537 INFO:teuthology.orchestra.run.smithi028.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T06:54:15.552 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:54:15.595 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:54:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T06:54:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:54:15.654 INFO:teuthology.orchestra.run.smithi028.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T06:54:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:54:15.704 INFO:teuthology.orchestra.run.smithi028.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-21T06:54:15.739 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:54:15.763 INFO:teuthology.orchestra.run.smithi028.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-21T06:54:15.812 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:54:15.822 INFO:teuthology.orchestra.run.smithi028.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T06:54:15.897 INFO:teuthology.orchestra.run.smithi028.stdout:(81/157): postgresql-server-13.16-1.el9.x86_64. 6.6 MB/s | 5.8 MB 00:00 2024-09-21T06:54:15.931 INFO:teuthology.orchestra.run.smithi028.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-21T06:54:15.945 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:54:15.997 INFO:teuthology.orchestra.run.smithi028.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T06:54:16.000 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:54:16.056 INFO:teuthology.orchestra.run.smithi028.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T06:54:16.131 INFO:teuthology.orchestra.run.smithi028.stdout:(85/157): python3-babel-2.9.1-2.el9.noarch.rpm 8.6 MB/s | 6.0 MB 00:00 2024-09-21T06:54:16.157 INFO:teuthology.orchestra.run.smithi028.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 768 kB/s | 77 kB 00:00 2024-09-21T06:54:16.173 INFO:teuthology.orchestra.run.smithi028.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T06:54:16.215 INFO:teuthology.orchestra.run.smithi028.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T06:54:16.241 INFO:teuthology.orchestra.run.smithi028.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T06:54:16.316 INFO:teuthology.orchestra.run.smithi028.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T06:54:16.341 INFO:teuthology.orchestra.run.smithi028.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-21T06:54:16.367 INFO:teuthology.orchestra.run.smithi028.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-21T06:54:16.392 INFO:teuthology.orchestra.run.smithi028.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-21T06:54:16.400 INFO:teuthology.orchestra.run.smithi129.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 576 kB/s | 2.4 MB 00:04 2024-09-21T06:54:16.406 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:54:16.406 INFO:teuthology.orchestra.run.smithi129.stdout:Total 9.7 MB/s | 228 MB 00:23 2024-09-21T06:54:16.417 INFO:teuthology.orchestra.run.smithi028.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-21T06:54:16.442 INFO:teuthology.orchestra.run.smithi028.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-21T06:54:16.476 INFO:teuthology.orchestra.run.smithi028.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T06:54:16.522 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:54:16.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:54:16.632 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:54:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:54:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:54:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:54:16.851 INFO:teuthology.orchestra.run.smithi028.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 88 kB/s | 36 kB 00:00 2024-09-21T06:54:16.876 INFO:teuthology.orchestra.run.smithi028.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 118 kB/s | 47 kB 00:00 2024-09-21T06:54:16.895 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:54:16.910 INFO:teuthology.orchestra.run.smithi028.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T06:54:16.935 INFO:teuthology.orchestra.run.smithi028.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-21T06:54:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:54:16.969 INFO:teuthology.orchestra.run.smithi028.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T06:54:16.994 INFO:teuthology.orchestra.run.smithi028.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T06:54:17.036 INFO:teuthology.orchestra.run.smithi028.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-21T06:54:17.050 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:54:17.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:54:17.128 INFO:teuthology.orchestra.run.smithi028.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-21T06:54:17.195 INFO:teuthology.orchestra.run.smithi028.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-21T06:54:17.196 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:54:17.228 INFO:teuthology.orchestra.run.smithi028.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:54:17.236 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:54:17.254 INFO:teuthology.orchestra.run.smithi028.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T06:54:17.272 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:54:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:54:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:54:17.371 INFO:teuthology.orchestra.run.smithi028.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:54:17.396 INFO:teuthology.orchestra.run.smithi028.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:54:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:54:17.422 INFO:teuthology.orchestra.run.smithi028.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:54:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:54:17.446 INFO:teuthology.orchestra.run.smithi028.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T06:54:17.480 INFO:teuthology.orchestra.run.smithi028.stdout:(112/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-21T06:54:17.514 INFO:teuthology.orchestra.run.smithi028.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T06:54:17.556 INFO:teuthology.orchestra.run.smithi028.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-21T06:54:17.576 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:54:17.581 INFO:teuthology.orchestra.run.smithi028.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:54:17.615 INFO:teuthology.orchestra.run.smithi028.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-09-21T06:54:17.616 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:54:17.640 INFO:teuthology.orchestra.run.smithi028.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-21T06:54:17.641 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-21T06:54:17.657 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:54:17.665 INFO:teuthology.orchestra.run.smithi028.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:54:17.699 INFO:teuthology.orchestra.run.smithi028.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-21T06:54:17.732 INFO:teuthology.orchestra.run.smithi028.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T06:54:17.758 INFO:teuthology.orchestra.run.smithi028.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:54:17.760 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:54:17.783 INFO:teuthology.orchestra.run.smithi028.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:54:17.793 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-21T06:54:17.793 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-21T06:54:17.799 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:54:17.808 INFO:teuthology.orchestra.run.smithi028.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T06:54:17.834 INFO:teuthology.orchestra.run.smithi028.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T06:54:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:54:17.859 INFO:teuthology.orchestra.run.smithi028.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T06:54:17.865 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:54:17.884 INFO:teuthology.orchestra.run.smithi028.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-21T06:54:17.909 INFO:teuthology.orchestra.run.smithi028.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T06:54:17.935 INFO:teuthology.orchestra.run.smithi028.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-21T06:54:17.956 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:54:17.993 INFO:teuthology.orchestra.run.smithi028.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-21T06:54:18.018 INFO:teuthology.orchestra.run.smithi028.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:54:18.044 INFO:teuthology.orchestra.run.smithi028.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:54:18.069 INFO:teuthology.orchestra.run.smithi028.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:54:18.161 INFO:teuthology.orchestra.run.smithi028.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-09-21T06:54:18.187 INFO:teuthology.orchestra.run.smithi028.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-21T06:54:18.212 INFO:teuthology.orchestra.run.smithi028.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:54:18.222 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:54:18.237 INFO:teuthology.orchestra.run.smithi028.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-21T06:54:18.262 INFO:teuthology.orchestra.run.smithi028.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-21T06:54:18.288 INFO:teuthology.orchestra.run.smithi028.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-21T06:54:18.313 INFO:teuthology.orchestra.run.smithi028.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:54:18.338 INFO:teuthology.orchestra.run.smithi028.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:54:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:54:18.361 INFO:teuthology.orchestra.run.smithi028.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 742 kB/s | 36 kB 00:00 2024-09-21T06:54:18.387 INFO:teuthology.orchestra.run.smithi028.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T06:54:18.392 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:54:18.420 INFO:teuthology.orchestra.run.smithi028.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T06:54:18.446 INFO:teuthology.orchestra.run.smithi028.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T06:54:18.471 INFO:teuthology.orchestra.run.smithi028.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 793 kB/s | 20 kB 00:00 2024-09-21T06:54:18.497 INFO:teuthology.orchestra.run.smithi028.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T06:54:18.522 INFO:teuthology.orchestra.run.smithi028.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T06:54:18.545 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:54:18.580 INFO:teuthology.orchestra.run.smithi028.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T06:54:18.725 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:54:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T06:54:18.799 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:54:18.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:54:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:54:18.911 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:54:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:54:18.948 INFO:teuthology.orchestra.run.smithi028.stdout:(150/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-21T06:54:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:54:19.006 INFO:teuthology.orchestra.run.smithi028.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.4 MB/s | 3.2 MB 00:00 2024-09-21T06:54:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:54:19.065 INFO:teuthology.orchestra.run.smithi028.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 704 kB/s | 41 kB 00:00 2024-09-21T06:54:19.099 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:54:19.142 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:54:19.157 INFO:teuthology.orchestra.run.smithi028.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-21T06:54:19.173 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:54:19.265 INFO:teuthology.orchestra.run.smithi028.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2024-09-21T06:54:19.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:54:19.307 INFO:teuthology.orchestra.run.smithi028.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-09-21T06:54:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:54:19.424 INFO:teuthology.orchestra.run.smithi028.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-21T06:54:19.508 INFO:teuthology.orchestra.run.smithi028.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-21T06:54:19.513 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:54:19.513 INFO:teuthology.orchestra.run.smithi028.stdout:Total 10 MB/s | 228 MB 00:22 2024-09-21T06:54:19.610 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-21T06:54:19.611 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-21T06:54:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:54:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:54:20.157 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:54:20.256 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:54:20.304 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:54:20.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:54:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:54:20.493 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:54:20.686 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:54:20.724 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:54:20.791 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-09-21T06:54:20.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:54:20.959 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-09-21T06:54:20.959 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-09-21T06:54:21.445 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:54:21.565 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:54:22.788 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:54:22.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:54:22.889 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:54:22.922 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:54:23.248 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:54:23.294 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:23.386 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:23.415 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:54:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:54:23.465 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-09-21T06:54:23.466 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-09-21T06:54:23.951 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:54:23.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:24.074 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:54:26.161 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-21T06:54:26.296 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:54:26.334 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:54:26.362 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:26.395 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:26.395 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:54:26.429 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:54:26.455 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:54:26.498 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:54:26.833 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:54:26.948 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:26.965 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:26.998 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:27.075 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:27.089 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:27.089 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:54:27.089 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:54:27.090 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:27.108 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:27.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:27.198 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:54:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:54:27.410 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:54:27.477 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:54:27.505 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:27.593 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:27.622 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:27.685 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:27.707 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:27.730 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:27.925 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:28.072 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:28.198 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:54:28.309 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:28.375 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:28.610 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:28.716 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:54:28.745 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:54:28.781 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:54:28.853 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:54:28.898 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:54:28.938 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:54:28.982 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:54:29.014 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:54:29.042 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:54:29.112 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:54:29.165 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:54:29.199 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:54:29.234 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:54:29.317 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:54:29.354 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:54:29.396 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:54:29.426 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:54:29.494 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:54:29.549 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:54:29.624 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:54:29.757 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:54:29.810 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:54:30.088 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-09-21T06:54:30.212 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:54:30.251 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:54:30.314 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:54:30.337 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:54:30.362 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:54:30.388 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:54:30.414 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:54:30.439 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:54:30.443 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:54:30.486 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:54:30.524 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:54:30.565 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:54:30.722 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:54:30.803 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:54:30.804 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:54:30.894 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:54:30.958 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:54:30.972 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:31.031 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:54:31.071 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:54:31.108 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:54:31.136 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:54:31.154 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:54:31.173 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:31.186 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:54:31.229 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:54:31.266 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:54:31.271 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:54:31.294 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:54:31.325 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:54:31.408 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:54:31.448 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:54:31.489 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:54:31.510 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:54:31.567 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:54:31.593 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:54:31.594 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:31.624 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:54:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:54:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:54:31.702 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:54:31.737 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:54:31.801 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:54:31.821 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:54:31.830 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:31.857 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:54:31.949 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:54:31.989 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:54:32.016 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:54:32.033 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:32.050 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:54:32.091 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:54:32.121 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:54:32.151 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:54:32.186 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:54:32.219 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:54:32.242 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:54:32.261 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:54:32.295 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:54:32.344 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:54:32.383 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:54:32.425 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:54:32.457 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:54:32.461 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:32.529 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:32.552 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:54:32.608 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:54:32.758 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:54:32.871 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:54:32.900 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:54:32.935 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:54:33.010 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:54:33.070 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:54:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:54:33.153 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:54:33.186 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:54:33.213 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:54:33.286 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:54:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:54:33.336 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:54:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:54:33.366 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:54:33.398 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:54:33.418 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:54:33.496 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:54:33.520 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:54:33.554 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:54:33.570 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:54:33.598 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:54:33.615 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:54:33.625 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:54:33.702 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:54:33.714 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:54:33.751 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:54:33.766 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:54:33.843 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:54:33.936 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:54:33.965 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:54:33.989 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:54:34.042 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:54:34.045 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:54:34.613 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:54:34.684 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:54:34.699 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:54:34.742 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:54:34.786 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:54:34.788 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:54:34.823 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:54:34.875 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:54:35.037 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:54:35.109 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:54:35.205 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:54:35.268 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:54:35.342 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:54:35.378 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:54:35.422 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:54:35.479 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:54:35.513 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:54:35.557 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:54:35.608 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:54:35.752 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:54:35.795 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:54:35.837 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:54:35.944 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:54:35.979 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:54:35.999 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:54:36.019 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:54:36.052 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:54:36.076 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:54:36.097 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:54:36.125 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:54:36.159 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:54:36.178 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:54:36.309 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:54:36.350 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:54:36.379 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:54:36.412 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:54:36.452 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:54:36.484 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:54:36.492 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:54:36.521 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:54:36.522 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:36.556 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:54:36.589 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:54:36.613 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:36.631 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:54:36.643 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:54:36.665 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:54:36.679 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:54:36.756 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:54:36.804 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:54:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:54:36.944 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:54:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:54:37.170 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:54:37.200 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:37.270 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:54:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:54:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:54:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:54:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:54:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:54:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:54:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:54:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:54:38.401 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:54:38.439 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:54:38.520 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-21T06:54:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:39.194 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:39.194 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:54:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:39.208 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:54:39.326 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:54:39.516 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:39.557 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:40.126 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:40.185 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:40.265 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:40.265 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:54:40.265 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:54:40.265 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:40.295 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:40.669 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:54:40.742 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:54:40.770 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:54:40.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:40.803 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:54:41.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:41.047 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:41.156 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:54:41.209 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:41.300 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:54:41.329 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:54:41.374 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:54:41.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:54:41.539 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:54:41.539 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:41.539 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:54:41.539 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:54:41.539 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:54:41.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:41.645 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:54:41.702 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:54:41.758 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:54:41.900 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:54:41.935 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:41.945 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:54:41.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:54:42.007 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:54:42.037 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:54:42.069 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:54:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:54:42.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:54:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:54:42.364 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:54:42.392 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:54:42.853 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:54:42.883 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:54:42.915 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:54:42.981 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:54:43.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:54:44.489 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:44.525 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:45.149 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:54:45.194 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:45.306 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:54:45.306 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:54:45.306 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:54:45.306 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:54:45.354 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:46.202 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:54:46.254 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:54:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:54:47.246 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:54:47.360 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:54:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:54:47.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:54:47.588 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:54:47.589 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:47.589 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:54:47.589 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:54:47.589 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:54:47.589 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:47.640 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:54:47.652 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:54:47.751 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:54:47.805 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:54:48.775 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:54:48.801 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:54:48.824 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:54:48.824 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:48.824 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:54:48.824 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:54:48.824 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:54:48.825 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:48.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:54:48.891 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:54:48.891 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:48.891 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:54:48.891 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:48.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:54:48.967 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:49.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:54:49.320 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:54:49.321 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:49.321 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:54:49.321 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:54:49.321 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:54:49.321 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:54:52.279 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:52.279 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-09-21T06:54:52.280 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:52.460 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:52.476 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:52.476 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:52.476 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:54:52.476 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:53.307 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:54:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:54:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:54:53.420 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:54:53.448 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:54:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:54:53.695 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:54:53.725 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:54:53.754 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:54:53.801 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:54:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:54.314 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:54.338 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:54.338 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:54.338 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:54:54.339 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:54.339 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:54.339 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:54:54.424 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:54:54.444 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:54:54.807 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:54:54.831 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:54:54.937 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:54:54.994 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:54:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:54:55.235 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:54:55.274 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:54:55.283 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:54:55.361 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:54:55.449 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:54:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:54:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:54:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:54:55.673 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:54:55.678 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:54:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:54:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:54:55.790 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:54:55.815 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:54:55.841 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:54:55.841 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:54:55.942 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:54:55.942 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:54:56.034 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:54:56.059 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:54:56.065 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:54:56.065 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:54:56.145 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:54:56.176 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:54:56.208 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:54:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:54:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:54:56.273 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:54:56.299 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:54:56.320 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:54:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:54:57.689 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:54:57.689 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /sys 2024-09-21T06:54:57.689 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /proc 2024-09-21T06:54:57.689 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /mnt 2024-09-21T06:54:57.689 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /var/tmp 2024-09-21T06:54:57.690 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /home 2024-09-21T06:54:57.690 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /root 2024-09-21T06:54:57.690 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /tmp 2024-09-21T06:54:57.690 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:54:57.874 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:57.891 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:54:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:54:57.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:54:59.500 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:54:59.552 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:59.556 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:54:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:54:59.580 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:59.580 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:54:59.581 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:59.581 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:54:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:54:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:54:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:55:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:55:00.383 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:00.383 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:55:00.383 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:55:00.384 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:55:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:55:00.525 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:55:00.548 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:55:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:55:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:55:00.663 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:55:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:55:00.832 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:55:00.858 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:55:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:55:00.882 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:55:00.883 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:00.883 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:55:00.883 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:55:00.883 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:55:00.883 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:00.934 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:55:00.946 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:55:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:55:01.041 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:55:01.045 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:55:01.099 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:55:01.184 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:55:01.220 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:55:01.252 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:55:01.280 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:55:01.683 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:55:01.722 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:55:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:55:01.829 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:55:01.860 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:55:02.070 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:55:02.104 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:55:02.128 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:55:02.128 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:02.128 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:55:02.128 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:55:02.128 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:55:02.129 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:02.171 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:55:02.194 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:55:02.194 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:02.194 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:55:02.194 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:02.238 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:55:02.263 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:55:02.263 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:02.263 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:55:02.263 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:55:02.264 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:55:02.264 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:55:02.612 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:55:02.613 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:02.613 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:55:02.613 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:55:02.613 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:55:02.613 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:55:02.788 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:55:02.789 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:55:02.790 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:55:02.791 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:55:02.792 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:55:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:55:05.253 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:55:05.307 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:55:05.666 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:05.666 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:55:05.666 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:55:05.667 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.668 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:55:05.669 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.670 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:55:05.671 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:55:05.672 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:55:05.673 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:55:05.674 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:55:05.675 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:55:05.676 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:55:05.677 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:55:05.678 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:55:05.679 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-21T06:55:06.113 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:06.321 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:55:06.349 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:55:06.473 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:55:06.602 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:55:06.644 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:55:06.649 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:55:06.676 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:55:06.686 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:55:06.701 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:06.716 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:55:06.743 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:55:06.751 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:55:06.764 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:55:06.866 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:55:06.921 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:55:06.926 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:55:06.974 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:55:07.004 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:55:07.237 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:55:07.237 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:55:07.678 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:07.714 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:07.733 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:07.935 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:55:07.970 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:55:07.996 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:08.037 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:55:08.062 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:55:08.062 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:08.062 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:55:08.062 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:08.113 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:55:08.138 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:08.489 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:55:08.514 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:08.570 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:55:08.643 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:55:08.683 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:55:08.765 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:55:08.813 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:55:08.838 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:55:08.873 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:55:08.873 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:55:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:55:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:55:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:55:09.066 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:55:09.071 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:09.071 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:09.251 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:09.251 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:55:09.318 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:55:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:12.752 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:55:12.793 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:55:12.834 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:55:12.865 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:55:12.900 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:55:13.126 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:55:13.172 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:55:13.202 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:55:13.242 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:55:13.286 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:55:13.853 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:13.892 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:13.913 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:55:14.816 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:55:14.921 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:55:14.968 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:55:15.073 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:55:15.107 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:55:15.132 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:55:15.167 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:55:15.167 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:55:15.259 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:55:15.260 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:55:15.343 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:55:15.368 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:55:15.374 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:15.374 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:15.562 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:55:15.562 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:55:15.638 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:55:15.683 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:15.683 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:55:15.683 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:55:15.684 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:55:15.685 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:55:15.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:55:15.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:55:15.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:55:15.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:55:15.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:55:15.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:55:15.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:55:15.703 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:55:15.704 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:55:15.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:55:15.715 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:18.211 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.212 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.213 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:55:18.214 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.215 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:55:18.216 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:55:18.217 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:55:18.218 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:55:18.219 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:55:18.220 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:55:18.221 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:55:18.222 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:55:18.223 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:55:18.223 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:55:18.223 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-21T06:55:18.600 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:55:21.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:55:21.863 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:55:21.863 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:55:21.863 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:55:21.863 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:55:21.863 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:55:21.864 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:55:21.865 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:55:21.866 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:55:21.867 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:55:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:55:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:55:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:55:21.871 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:55:21.872 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:55:21.873 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:55:21.874 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:55:24.572 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:55:24.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout:Upgraded: 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:55:24.573 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.574 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:55:24.575 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:55:24.576 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:55:24.577 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:55:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:55:24.579 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:55:24.580 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:55:24.581 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:55:24.582 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:55:24.583 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.584 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:55:24.585 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-09-21T06:55:25.027 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:25.028 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:25.180 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:55:25.203 INFO:teuthology.orchestra.run.smithi028.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.203 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.203 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:55:25.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:25.352 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:55:25.379 INFO:teuthology.orchestra.run.smithi129.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.379 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.380 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:55:25.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:25.527 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:55:25.554 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.554 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:55:25.554 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:55:25.556 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:55:25.557 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:55:25.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:55:25.586 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:55:25.586 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:55:25.619 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:55:25.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:55:25.651 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:55:25.652 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:55:25.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:55:25.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:55:25.746 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:55:25.746 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:55:25.776 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:55:25.845 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:55:25.846 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:55:25.875 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:55:25.943 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:55:25.943 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:55:25.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:55:25.971 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:55:26.038 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:55:26.038 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:55:26.067 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:55:26.135 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:55:26.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:55:26.161 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:55:26.227 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:55:26.227 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:55:26.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:55:26.255 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:55:26.322 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:55:26.322 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:55:26.349 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:55:26.416 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:55:26.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:55:26.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:55:26.508 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:55:26.607 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:55:26.607 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:26.608 INFO:tasks.cephadm:Cluster fsid is 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:55:26.608 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:55:26.608 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.28', 'mon.b': '172.21.15.129', 'mon.c': '172.21.15.181'} 2024-09-21T06:55:26.608 INFO:tasks.cephadm:First mon is mon.a on smithi028 2024-09-21T06:55:26.608 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:55:26.608 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:55:26.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname $(hostname -s) 2024-09-21T06:55:26.638 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname $(hostname -s) 2024-09-21T06:55:26.667 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-09-21T06:55:26.692 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:55:26.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:26.836 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:55:26.980 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:26.982 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:55:26.982 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:55:26.982 DEBUG:teuthology.orchestra.run.smithi028:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:27.530 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:55 /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:27.531 DEBUG:teuthology.orchestra.run.smithi129:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.052 INFO:teuthology.orchestra.run.smithi129.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:55 /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.052 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.586 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:55 /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.587 DEBUG:teuthology.orchestra.run.smithi028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.607 DEBUG:teuthology.orchestra.run.smithi129:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.627 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:55:28.661 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:55:28.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:55:28.664 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:55:28.670 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:55:30.237 INFO:teuthology.orchestra.run.smithi129.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:55:30.253 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:55:30.270 INFO:teuthology.orchestra.run.smithi028.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:56:01.260 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T06:56:01.260 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:56:01.260 INFO:teuthology.orchestra.run.smithi028.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:56:01.260 INFO:teuthology.orchestra.run.smithi028.stdout: "repo_digests": [ 2024-09-21T06:56:01.260 INFO:teuthology.orchestra.run.smithi028.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:56:01.261 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T06:56:01.261 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T06:56:02.845 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout: "repo_digests": [ 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-21T06:56:02.846 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T06:56:02.872 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T06:56:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:56:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:56:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-09-21T06:56:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:56:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-21T06:56:02.873 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T06:56:02.898 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph 2024-09-21T06:56:02.932 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph 2024-09-21T06:56:02.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-09-21T06:56:02.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /etc/ceph 2024-09-21T06:56:03.015 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /etc/ceph 2024-09-21T06:56:03.040 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-09-21T06:56:03.064 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:56:03.065 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:56:03.066 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:56:03.067 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:56:03.068 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:56:03.068 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:56:03.086 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7b450f7c-77e6-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T06:56:03.086 DEBUG:teuthology.orchestra.run.smithi028:mon.a> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:56:03.128 DEBUG:teuthology.orchestra.run.smithi028:mgr.x> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:56:03.171 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:56:03.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:56:03.383 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:56:03.383 INFO:teuthology.orchestra.run.smithi028.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.28', '--skip-admin-label'] 2024-09-21T06:56:03.384 INFO:teuthology.orchestra.run.smithi028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:56:03.384 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying podman|docker is present... 2024-09-21T06:56:03.409 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:56:03.409 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying lvm2 is present... 2024-09-21T06:56:03.409 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying time synchronization is in place... 2024-09-21T06:56:03.416 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:56:03.416 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:56:03.423 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:56:03.423 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:56:03.430 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout enabled 2024-09-21T06:56:03.436 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout active 2024-09-21T06:56:03.436 INFO:teuthology.orchestra.run.smithi028.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:56:03.436 INFO:teuthology.orchestra.run.smithi028.stdout:Repeating the final host check... 2024-09-21T06:56:03.459 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:56:03.459 INFO:teuthology.orchestra.run.smithi028.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:56:03.459 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl is present 2024-09-21T06:56:03.459 INFO:teuthology.orchestra.run.smithi028.stdout:lvcreate is present 2024-09-21T06:56:03.466 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:56:03.466 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:56:03.472 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:56:03.472 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:56:03.479 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout enabled 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout active 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:Host looks OK 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:Cluster fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:Acquiring lock 140287355103600 on /run/cephadm/7b450f7c-77e6-11ef-baf5-efdc52797490.lock 2024-09-21T06:56:03.486 INFO:teuthology.orchestra.run.smithi028.stdout:Lock 140287355103600 acquired on /run/cephadm/7b450f7c-77e6-11ef-baf5-efdc52797490.lock 2024-09-21T06:56:03.487 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying IP 172.21.15.28 port 3300 ... 2024-09-21T06:56:03.487 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying IP 172.21.15.28 port 6789 ... 2024-09-21T06:56:03.487 INFO:teuthology.orchestra.run.smithi028.stdout:Base mon IP(s) is [172.21.15.28:3300, 172.21.15.28:6789], mon addrv is [v2:172.21.15.28:3300,v1:172.21.15.28:6789] 2024-09-21T06:56:03.490 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.28 metric 100 2024-09-21T06:56:03.490 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.28 metric 100 2024-09-21T06:56:03.493 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:56:03.493 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:56:03.493 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1786sec hoplimit 64 pref medium 2024-09-21T06:56:03.495 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:56:03.495 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:Mon IP `172.21.15.28` is in CIDR network `172.21.0.0/20` 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:Mon IP `172.21.15.28` is in CIDR network `172.21.0.0/20` 2024-09-21T06:56:03.496 INFO:teuthology.orchestra.run.smithi028.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:56:03.497 INFO:teuthology.orchestra.run.smithi028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:56:03.498 INFO:teuthology.orchestra.run.smithi028.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:56:03.994 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:56:03.995 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:56:12.921 INFO:teuthology.orchestra.run.smithi028.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:56:12.921 INFO:teuthology.orchestra.run.smithi028.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:56:12.921 INFO:teuthology.orchestra.run.smithi028.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:56:16.771 INFO:teuthology.orchestra.run.smithi028.stdout:stat: stdout 167 167 2024-09-21T06:56:16.771 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial keys... 2024-09-21T06:56:17.591 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQARbu5m8hDBBhAADidNUy6BeGCAzN7rGyIEEw== 2024-09-21T06:56:18.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQARbu5m2WuWNRAAbIntpsok7c3pFDoOimMy9Q== 2024-09-21T06:56:19.411 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQASbu5mlFGhMRAAM/S9v5o+mTicwUIeIsylfw== 2024-09-21T06:56:19.413 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial monmap... 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool for a [v2:172.21.15.28:3300,v1:172.21.15.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: set fsid to 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:20.518 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:56:20.519 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:56:20.519 INFO:teuthology.orchestra.run.smithi028.stdout:Creating mon... 2024-09-21T06:56:21.406 INFO:teuthology.orchestra.run.smithi028.stdout:create mon.a on 2024-09-21T06:56:21.709 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:56:22.013 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:56:22.540 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target. 2024-09-21T06:56:22.541 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target. 2024-09-21T06:56:22.791 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:56:22.792 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:56:22.970 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target.wants/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@.service. 2024-09-21T06:56:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 podman[30827]: 2024-09-21 06:56:23.112629207 +0000 UTC m=+0.016917365 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:56:23.510 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:56:23.510 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-09-21T06:56:23.517 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:56:23.517 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:56:23.518 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-09-21T06:56:23.518 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:56:23.518 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mon to start... 2024-09-21T06:56:23.518 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mon... 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 podman[30827]: 2024-09-21 06:56:23.412428829 +0000 UTC m=+0.316716979 container init 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 podman[30827]: 2024-09-21 06:56:23.416027104 +0000 UTC m=+0.320315252 container start 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 ceph-mon[30847]: mkfs 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 ceph-mon[30847]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 bash[30827]: 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec 2024-09-21T06:56:23.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:23 smithi028 systemd[1]: Started Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:56:24.489 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:56:24.489 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout id: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:24.489 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:56:24.489 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.512024s) 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:56:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:56:24.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:56:24.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:24.491 INFO:teuthology.orchestra.run.smithi028.stdout:mon is available 2024-09-21T06:56:24.491 INFO:teuthology.orchestra.run.smithi028.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: monmap epoch 1 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: last_changed 2024-09-21T06:56:19.738103+0000 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: min_mon_release 19 (squid) 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: election_strategy: 1 2024-09-21T06:56:24.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:56:24.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: fsmap 2024-09-21T06:56:24.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:56:24.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: mgrmap e1: no daemons active 2024-09-21T06:56:24.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:24 smithi028 ceph-mon[30847]: from='client.? 172.21.15.28:0/1734493389' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:56:25.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:25 smithi028 ceph-mon[30847]: from='client.? 172.21.15.28:0/3773450324' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:56:25.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:25 smithi028 ceph-mon[30847]: from='client.? 172.21.15.28:0/3773450324' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:56:25.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout fsid = 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.28:3300,v1:172.21.15.28:6789] 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:56:25.554 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:56:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:56:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:56:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:56:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:56:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:Generating new minimal ceph.conf... 2024-09-21T06:56:26.508 INFO:teuthology.orchestra.run.smithi028.stdout:Restarting the monitor... 2024-09-21T06:56:26.784 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:26 smithi028 ceph-mon[30847]: from='client.? 172.21.15.28:0/2499445278' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:56:26.784 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:26 smithi028 systemd[1]: Stopping Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:56:27.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a[30842]: 2024-09-21T06:56:26.781+0000 7ff970d81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:56:27.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a[30842]: 2024-09-21T06:56:26.781+0000 7ff970d81640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:56:27.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:26 smithi028 podman[31092]: 2024-09-21 06:56:26.997254956 +0000 UTC m=+0.319904435 container died 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:56:27.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 podman[31092]: 2024-09-21 06:56:27.347869146 +0000 UTC m=+0.670518614 container cleanup 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:56:27.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 bash[31092]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:56:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 podman[31106]: 2024-09-21 06:56:27.715414164 +0000 UTC m=+0.718851083 container remove 499f4ad8616bf8e0c62c31f46e58632d7485521d5591041cc2bbfa19c75c4bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:56:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:56:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 systemd[1]: Stopped Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:56:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:27 smithi028 systemd[1]: Starting Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 podman[31195]: 2024-09-21 06:56:28.149598105 +0000 UTC m=+0.108181162 container create dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 podman[31195]: 2024-09-21 06:56:28.057630281 +0000 UTC m=+0.016213310 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 podman[31195]: 2024-09-21 06:56:28.327758433 +0000 UTC m=+0.286341453 container init dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 podman[31195]: 2024-09-21 06:56:28.331099228 +0000 UTC m=+0.289682243 container start dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: pidfile_write: ignore empty --pid-file 2024-09-21T06:56:28.423 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: load: jerasure load: lrc 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Git sha 0 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: DB SUMMARY 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: DB Session ID: PQNKDJI7GSTWSSVEQEN4 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94842 ; 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:56:28.424 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.env: 0x55dd4d9bbd60 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.info_log: 0x55dd533f7360 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.statistics: (nil) 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.use_fsync: 0 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:56:28.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.db_log_dir: 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.wal_dir: 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:56:28.426 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.write_buffer_manager: 0x55dd533fbd60 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.unordered_write: 0 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:56:28.427 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.row_cache: None 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.wal_filter: None 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.wal_compression: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:56:28.428 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:56:28.429 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:56:28.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:56:28.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_open_files: -1 2024-09-21T06:56:28.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Compression algorithms supported: 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kZSTD supported: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:56:28.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:56:28.432 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.merge_operator: 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_filter: None 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:56:28.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dd533f6fa0) 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_type: 0 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: data_block_index_type: 0 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_shortening: 1 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:56:28.435 INFO:journalctl@ceph.mon.a.smithi028.stdout: checksum: 4 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: no_block_cache: 0 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache: 0x55dd4f3bb610 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_options: 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: capacity : 536870912 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: num_shard_bits : 4 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: strict_capacity_limit : 0 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_compressed: (nil) 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: persistent_cache: (nil) 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_size: 4096 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_size_deviation: 10 2024-09-21T06:56:28.436 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_restart_interval: 16 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_block_restart_interval: 1 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: metadata_block_size: 4096 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: partition_filters: 0 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: use_delta_encoding: 1 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: filter_policy: bloomfilter 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: whole_key_filtering: 1 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: verify_compression: 0 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: format_version: 5 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: enable_index_compression: 1 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_align: 0 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: max_auto_readahead_size: 262144 2024-09-21T06:56:28.437 INFO:journalctl@ceph.mon.a.smithi028.stdout: prepopulate_block_cache: 0 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression: NoCompression 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.num_levels: 7 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:56:28.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:56:28.439 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:56:28.440 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:56:28.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:56:28.442 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.ttl: 2592000 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:56:28.443 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 480d0f6d-3537-45cf-a47a-c9a87b2673ce 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901788367489, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:56:28.444 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901788368660, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91055, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 89103, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11605, "raw_average_key_size": 47, "raw_value_size": 82534, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726901788, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "480d0f6d-3537-45cf-a47a-c9a87b2673ce", "db_session_id": "PQNKDJI7GSTWSSVEQEN4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901788368760, "job": 1, "event": "recovery_finished"} 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dd5341aa80 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: DB pointer 0x55dd541c0000 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** DB Stats ** 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:56:28.445 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** Compaction Stats [default] ** 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: L0 2/0 90.78 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Sum 2/0 90.78 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 122.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** Compaction Stats [default] ** 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:56:28.446 INFO:journalctl@ceph.mon.a.smithi028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 122.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative compaction: 0.00 GB write, 24.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval compaction: 0.00 GB write, 24.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Block cache BinnedLRUCache@0x55dd4f3bb610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T06:56:28.447 INFO:journalctl@ceph.mon.a.smithi028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: starting mon.a rank 0 at public addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] at bind addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???) e1 preinit fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).mds e1 new map 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: e1 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: btime 2024-09-21T06:56:23:464631+0000 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: legacy client fscid: -1 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout: No filesystems configured 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:56:28.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:56:28.449 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:56:28.449 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:56:28.449 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:56:28.449 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 bash[31195]: dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 2024-09-21T06:56:28.449 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 systemd[1]: Started Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:56:28.449 INFO:teuthology.orchestra.run.smithi028.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: monmap epoch 1 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: last_changed 2024-09-21T06:56:19.738103+0000 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: min_mon_release 19 (squid) 2024-09-21T06:56:28.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: election_strategy: 1 2024-09-21T06:56:28.707 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:56:28.707 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: fsmap 2024-09-21T06:56:28.707 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:56:28.707 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:28 smithi028 ceph-mon[31213]: mgrmap e1: no daemons active 2024-09-21T06:56:29.395 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:56:29.408 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:56:29.408 INFO:teuthology.orchestra.run.smithi028.stdout:Creating mgr... 2024-09-21T06:56:29.409 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:56:29.409 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:56:29.656 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:56:29.656 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:56:29.814 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490.target.wants/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@.service. 2024-09-21T06:56:30.142 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:29 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/985329215' entity='client.admin' 2024-09-21T06:56:30.345 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:56:30.345 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-09-21T06:56:30.352 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:56:30.353 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:56:30.353 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-09-21T06:56:30.353 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:56:30.361 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:56:30.362 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr to start... 2024-09-21T06:56:30.370 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr... 2024-09-21T06:56:30.489 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:30 smithi028 systemd[1]: Started Ceph mgr.x for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:56:31.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:30 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2454740327' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:56:31.522 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:31.524 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:31.525 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:56:31.526 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:56:31.529 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:56:31.529 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:56:31.529 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:56:23:464631+0000", 2024-09-21T06:56:31.530 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:56:23.465431+0000", 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:56:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:56:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:34 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/968475312' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:56:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:56:34.701 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.702 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:56:23:464631+0000", 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:56:34.703 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.704 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:56:23.465431+0000", 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:56:34.705 INFO:teuthology.orchestra.run.smithi028.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: Activating manager daemon x 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: mgrmap e2: x(active, starting, since 0.00386545s) 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:56:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: Manager daemon x is now available 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' 2024-09-21T06:56:36.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:35 smithi028 ceph-mon[31213]: from='mgr.14100 172.21.15.28:0/2180383701' entity='mgr.x' 2024-09-21T06:56:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:37 smithi028 ceph-mon[31213]: mgrmap e3: x(active, since 1.0086s) 2024-09-21T06:56:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:37 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/342143325' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:56:37.996 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:56:37.997 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:56:37.998 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:56:37.999 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:56:23:464631+0000", 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:56:38.000 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:56:23.465431+0000", 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:56:38.001 INFO:teuthology.orchestra.run.smithi028.stdout:mgr is available 2024-09-21T06:56:38.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:38 smithi028 ceph-mon[31213]: mgrmap e4: x(active, since 2s) 2024-09-21T06:56:39.166 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:39.166 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout fsid = 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.28:3300,v1:172.21.15.28:6789] 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:56:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:56:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:56:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:56:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:56:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:56:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:Enabling cephadm module... 2024-09-21T06:56:39.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:39 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/577198656' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:56:40.909 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:40 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2108426556' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:56:40.910 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:40 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setuser ceph since I am not root 2024-09-21T06:56:40.910 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:40 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setgroup ceph since I am not root 2024-09-21T06:56:41.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:41 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2108426556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:56:41.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:41 smithi028 ceph-mon[31213]: mgrmap e5: x(active, since 5s) 2024-09-21T06:56:42.501 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:56:42.501 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:56:42.501 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:56:42.502 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:56:42.502 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:56:42.502 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:56:42.502 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for the mgr to restart... 2024-09-21T06:56:42.502 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr epoch 5... 2024-09-21T06:56:42.775 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:42 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3989527414' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: Active manager daemon x restarted 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: Activating manager daemon x 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: mgrmap e6: x(active, starting, since 0.00352126s) 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:56:46.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:45 smithi028 ceph-mon[31213]: Manager daemon x is now available 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:mgr epoch 5 is available 2024-09-21T06:56:47.491 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: mgrmap e7: x(active, since 1.00555s) 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:56:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:47 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:56:49.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/99783548' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:56:49.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/99783548' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:56:49.027 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-mon[31213]: mgrmap e8: x(active, since 2s) 2024-09-21T06:56:49.027 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:56:48.895+0000 7f7d8e46c640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:56:48] ENGINE Error in HTTPServer.serve 2024-09-21T06:56:49.027 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: Traceback (most recent call last): 2024-09-21T06:56:49.027 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:56:49.027 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._connections.run(self.expiration_interval) 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._run(expiration_interval) 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: s = self.context.wrap_socket( 2024-09-21T06:56:49.028 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: return self.sslsocket_class._create( 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self.do_handshake() 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._sslobj.do_handshake() 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:56:49.029 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:56:49.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:56:49.030 INFO:teuthology.orchestra.run.smithi028.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: [21/Sep/2024:06:56:48] ENGINE Bus STARTING 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: [21/Sep/2024:06:56:48] ENGINE Serving on http://172.21.15.28:8765 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: [21/Sep/2024:06:56:48] ENGINE Serving on https://172.21.15.28:7150 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: [21/Sep/2024:06:56:48] ENGINE Bus STARTED 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:56:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: [21/Sep/2024:06:56:48] ENGINE Error in HTTPServer.serve 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: Traceback (most recent call last): 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._run(expiration_interval) 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: s = self.context.wrap_socket( 2024-09-21T06:56:50.049 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: return self.sslsocket_class._create( 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: self.do_handshake() 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._sslobj.do_handshake() 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:50.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:49 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:56:51.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:50 smithi028 ceph-mon[31213]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:56:51.483 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:56:51.483 INFO:teuthology.orchestra.run.smithi028.stdout:Generating ssh key... 2024-09-21T06:56:52.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:51 smithi028 ceph-mon[31213]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: Generating public/private rsa key pair. 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: Your identification has been saved in /tmp/tmp4gic56jo/key 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: Your public key has been saved in /tmp/tmp4gic56jo/key.pub 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: The key fingerprint is: 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: SHA256:NGXMe1BlZhGlrDCf1Amtewwqm96ubNonBhrNBb79cEI ceph-7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: The key's randomart image is: 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: +---[RSA 3072]----+ 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | oo.ooB+.| 2024-09-21T06:56:52.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | . o+ B.o | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | . .o oo..= | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | ..E..=+o | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | o =S o++ | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | . = = o . o | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | o . O . | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | . o*.o | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: | .===o | 2024-09-21T06:56:52.870 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:56:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: +----[SHA256]-----+ 2024-09-21T06:56:53.766 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:53 smithi028 ceph-mon[31213]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:56:53.767 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:53 smithi028 ceph-mon[31213]: Generating ssh key... 2024-09-21T06:56:53.767 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:53 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:53.767 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:53 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:54.310 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:56:54.311 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:56:54.311 INFO:teuthology.orchestra.run.smithi028.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:56:54.321 INFO:teuthology.orchestra.run.smithi028.stdout:Adding host smithi028... 2024-09-21T06:56:55.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:54 smithi028 ceph-mon[31213]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:56:55.945 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:55 smithi028 ceph-mon[31213]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi028", "addr": "172.21.15.28", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:56:56.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:56 smithi028 ceph-mon[31213]: Deploying cephadm binary to smithi028 2024-09-21T06:56:59.300 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Added host 'smithi028' with addr '172.21.15.28' 2024-09-21T06:56:59.301 INFO:teuthology.orchestra.run.smithi028.stdout:Deploying unmanaged mon service... 2024-09-21T06:56:59.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:59 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:56:59.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:59 smithi028 ceph-mon[31213]: Added host smithi028 2024-09-21T06:56:59.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:56:59 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:00.686 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:57:00.686 INFO:teuthology.orchestra.run.smithi028.stdout:Deploying unmanaged mgr service... 2024-09-21T06:57:01.281 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:00 smithi028 ceph-mon[31213]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:01.281 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:00 smithi028 ceph-mon[31213]: Saving service mon spec with placement count:5 2024-09-21T06:57:01.281 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:00 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:02.263 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:57:02.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:02 smithi028 ceph-mon[31213]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:02.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:02 smithi028 ceph-mon[31213]: Saving service mgr spec with placement count:2 2024-09-21T06:57:02.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:02 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:03.931 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:03 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:03.932 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:03 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:03.932 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:03 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2066029596' entity='client.admin' 2024-09-21T06:57:05.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:05 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:05.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:05 smithi028 ceph-mon[31213]: from='mgr.14118 172.21.15.28:0/3142498458' entity='mgr.x' 2024-09-21T06:57:05.445 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/953941228' entity='client.admin' 2024-09-21T06:57:05.698 INFO:teuthology.orchestra.run.smithi028.stdout:Enabling the dashboard module... 2024-09-21T06:57:07.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:06 smithi028 ceph-mon[31213]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:07.164 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:06 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/290645939' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:57:07.164 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setuser ceph since I am not root 2024-09-21T06:57:07.164 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setgroup ceph since I am not root 2024-09-21T06:57:08.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:07 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/290645939' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:57:08.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:07 smithi028 ceph-mon[31213]: mgrmap e9: x(active, since 21s) 2024-09-21T06:57:09.006 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:08 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1738834289' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for the mgr to restart... 2024-09-21T06:57:09.009 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr epoch 9... 2024-09-21T06:57:12.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: Active manager daemon x restarted 2024-09-21T06:57:12.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: Activating manager daemon x 2024-09-21T06:57:12.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:57:12.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: mgrmap e10: x(active, starting, since 0.00383095s) 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:57:12.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:12 smithi028 ceph-mon[31213]: Manager daemon x is now available 2024-09-21T06:57:13.469 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:13.469 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:57:13.470 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:57:13.470 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:13 smithi028 ceph-mon[31213]: mgrmap e11: x(active, since 1.00759s) 2024-09-21T06:57:13.764 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:57:13.765 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T06:57:13.765 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:57:13.765 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:57:13.765 INFO:teuthology.orchestra.run.smithi028.stdout:mgr epoch 9 is available 2024-09-21T06:57:13.765 INFO:teuthology.orchestra.run.smithi028.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:57:14.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:14 smithi028 ceph-mon[31213]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:57:14.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:14 smithi028 ceph-mon[31213]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:57:15.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-mon[31213]: mgrmap e12: x(active, since 2s) 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-mon[31213]: [21/Sep/2024:06:57:14] ENGINE Bus STARTING 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:57:15.150+0000 7f8972346640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:57:15] ENGINE Error in HTTPServer.serve 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: Traceback (most recent call last): 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._connections.run(self.expiration_interval) 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:57:15.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._run(expiration_interval) 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: s = self.context.wrap_socket( 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: return self.sslsocket_class._create( 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self.do_handshake() 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: self._sslobj.do_handshake() 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:57:15.549 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 06:57:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: [21/Sep/2024:06:57:15] ENGINE Serving on http://172.21.15.28:8765 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: [21/Sep/2024:06:57:15] ENGINE Serving on https://172.21.15.28:7150 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: [21/Sep/2024:06:57:15] ENGINE Bus STARTED 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: [21/Sep/2024:06:57:15] ENGINE Error in HTTPServer.serve 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: Traceback (most recent call last): 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._run(expiration_interval) 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:57:16.548 INFO:journalctl@ceph.mon.a.smithi028.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: s = self.context.wrap_socket( 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: return self.sslsocket_class._create( 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: self.do_handshake() 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: self._sslobj.do_handshake() 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:57:16.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:17.346 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUN8+hygstalLDiY+cVX3BkyJkQv8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2NTcxNloXDTM0\nMDkyMjA2NTcxNlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjI4MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAyq2ZAI81VtbrIuLW+A483z3n7i3PwA3jVfCu\nLp9P0UEcMoWMOtk+bni2HumY6kvfzTEeTSBUSwZLreUQVHt2XtDKKXnuaq+zpGD1\n+KcS/e6PI+MxcUkWK0DSZk3nyKCWTnfBlqmbpjo4Rh61Wv3/rXwbD0rA/N++yWXr\nGRlY6BMP4C9EQPEOo9mGXx/OBPl7P8dkIB0yxMfHO3T+GMuNLJ+2Qyx/1ObTo+dw\ntUrLivNd2MyNztr4ITZUSqkzcEE0hj+Ncc4rQC5XjpJkl+wJ333kptgZTQ7w7AsN\nskLPCKbcuomWFDylpYWkH4hG6JAjfGzdKvVyKI/XBAHvUGFROUbWhS3q4j/+E+Ka\nqbT9g7qEK4DE1cdkVlDQMC0xQm24y5HpXNbmmMwGWuPZYty/Zkd7OQ2LoBNRMWDW\n+hy6hThYrsKZdfJJjCnNoZ0Y5sKZvvpU8+6Lhc5Mvgr+R8kjvSMBibdUztELaUJW\nCP8DWLY7oCbs08aOkbaHPIrGHR60/Ef1e/KDvpIiHfho6WLU9rUQrHPKbedxkkNS\nhRVDgyzr1Zc552clWdnIWJthOGpTC69sdbZdeOcmSwLhrXtuQh4TuJhcY6RbcHzx\nD6M5gdw3gDeHaJmBUe9telrP+5v9klIIqeQ+6lhzuLstEb/VhVHgqkaW0Vc2450/\nFzf2oCkCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDI4LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPHDAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQBlz2/daNsJ5oCXZqRjazgnaywAa6chCN9MfKvP\nf/4A7n2z4IIflJu2CHg1JjPmKVuYwUo9XSbZPO/cGGi96gIhv+OciNmcu+dnLYeN\n2KeDDMw4k3FsvY8GZ1IiJLbB3wnPB3UCNbBHhsD3qNjGqoYPKIXttcbUZWF24cmS\nDtYqNGgbxg+dDSTDuCNo1I7iFjEyRhQxYsG6qnbA7vS3ATI13/UNBT5Bzn2W2v50\n+v0YHicJ+mNvSmtTOlhLU3OVwwHCs/L+UUCmlcCVdbXeIgE0/waDxTxTS+F3b21H\nE1/2puxwNpQAeaikLaPkVaPylaJYnfRtHKASQ2ZX3YYGlcctMTEjJWt0RU4C8wJl\nFY03LO7DutiARNgODZOcSCTNiNZBJG1GCne5j4dkC1nCEkvd6xSUxdQPtQcvi8fo\nRTx3lOdtgAACAeKMnl/0cRsWJZJDIXsZ7uR62BC8VI8+AZWKOQkz/gyNmT2fiHI6\nDnCY/j6dCJ1kn19zy1BT9m29Ob5cFy6ONzYDcz7RWkbmsdwoQMEZIO0j+OSarFQv\n9lpZF2KP+ZIdJ9N4SCBCZ8N4kL2kOPtZvWRTF2LWItXCKDZ0igsRawu/9EAXgfYj\neS+IwXi62FU+uzlfvgSIPglnAcC1izkAgDeoZdi3SWmFOtHMTJA9BMyZoim0Al6T\nuPrudg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAyq2ZAI81VtbrIuLW+A483z3n7i3PwA3jVfCuLp9P0UEcMoWM\nOtk+bni2HumY6kvfzTEeTSBUSwZLreUQVHt2XtDKKXnuaq+zpGD1+KcS/e6PI+Mx\ncUkWK0DSZk3nyKCWTnfBlqmbpjo4Rh61Wv3/rXwbD0rA/N++yWXrGRlY6BMP4C9E\nQPEOo9mGXx/OBPl7P8dkIB0yxMfHO3T+GMuNLJ+2Qyx/1ObTo+dwtUrLivNd2MyN\nztr4ITZUSqkzcEE0hj+Ncc4rQC5XjpJkl+wJ333kptgZTQ7w7AsNskLPCKbcuomW\nFDylpYWkH4hG6JAjfGzdKvVyKI/XBAHvUGFROUbWhS3q4j/+E+KaqbT9g7qEK4DE\n1cdkVlDQMC0xQm24y5HpXNbmmMwGWuPZYty/Zkd7OQ2LoBNRMWDW+hy6hThYrsKZ\ndfJJjCnNoZ0Y5sKZvvpU8+6Lhc5Mvgr+R8kjvSMBibdUztELaUJWCP8DWLY7oCbs\n08aOkbaHPIrGHR60/Ef1e/KDvpIiHfho6WLU9rUQrHPKbedxkkNShRVDgyzr1Zc5\n52clWdnIWJthOGpTC69sdbZdeOcmSwLhrXtuQh4TuJhcY6RbcHzxD6M5gdw3gDeH\naJmBUe9telrP+5v9klIIqeQ+6lhzuLstEb/VhVHgqkaW0Vc2450/Fzf2oCkCAwEA\nAQKCAgAk2q5AsMnFMa1uGYt3bbdZ7LrYz5HAXYYiIXK63ZM4/Lrw4OHf7ZLxqZeM\nRXPd3tAiUrUs1x0cy1dFlqqCgjTDBvpL0nUtBygGUu9HOLI2ZIO4xd4+uEiEsvPP\nUIk+LR1HxXT5PXwlHN8QuRLHKfqtBC0zeadgFBtwKc03Mim9gYHYhR/HI05DMxHB\nCFqBAxCLR2mIgWay65Tp1dtCjPjtzVjqHBRelV6UpkgTXzdl290LyB5dJ+oIuAVZ\n0iydU+4GH1ZMBG5O7F5VeX87NNuSvSSvxgnLvlTGxzfFW2qkKxtl/BDDO0fvsj5m\n0XP7ZAJf5LfO0PTiNU2m1+c5WYjYK4sB/5HB4bjoFwNIJTh4byXwuZTGPbjhyekD\nI64qMJlKcfUo99+0uYbSNpzc+cndmsH4t6kd6orzOpVcrK4qRXwXCgH9I+8cUh91\n6rvZrrZC4Vef9r4w2+qD2fPgS4D9+3u6qKc1Q3y+BvYXC4GUvuJcSW1OCDg5dbI/\nq9dtDIM6XbwhifIj9N7I7oBONYCvYFjJ+QaKAouSidSw76xCV5eHFFcrBGNt8HCj\n+KfIsm+NQRQVrE6d1/YYhQse6bSMw/OcWQru7rTIqYa2xmTdm88MZjmqZpBSXtzr\n1LU2iPZ2SRycQ2Uj4JnRSETvb4GJZRiW2hhZw43EnKrN/EDOxQKCAQEA669QXngl\nEVLG2gJUDb59tRB3MHL7ej1CELdG7+szqkbHH3QGA1FS37XULfZCe5UuVnCF2LVK\nV7eAXDMkEfkAh5o5urbeW5eRhXamiP8AfE6nxU2vndgx5ae5hwYV53ATfTshwDSc\nqo4/DmB0vtJHQjSW3adP51B/JzYOZKblh7RY757Fq5Nw8/utCiakk00qDJwgom6N\nPRPDD+yzZ4KlSkJpqeplggqwMH+ZYf/kTk9OSqKlelvcgzbvJ4TZ2fxwM7LoChsZ\nfg3/gSRIu1O4aoOJO0QMZwGCB0da1ereML16614t2Ye3o/PQpRCIKxBN1sVp+2Xu\nzVgBRa8bFz1e5wKCAQEA3CXy3rSixU4NTGfNtHc/xduB+G0uenSTK4WbyDvQRxOE\neVdPHR9pFYFRNhFzSSbLYUs+M8nG7af12zBNAgmn16PUbg1yBLhgDZWZhmPU0bZQ\nzwV6Lxl2Gw37uCeqIRa6Ei3RJ3EDPYn0/6X3jIDjus7g/Z76OeQBdkEEmdfKyQcm\nUjSoRO0gP2ujfjQ/UL8YtA1MFb8PEIsc6ec1q1JdCkF6R52AJJhYrV/wSFC8qD5D\nYmWFCg37MvqgYZbfK5A6b47YD3D1Y8SzdqWb5ZBU7uguz59Pj5ucdCPqxHsCsREP\n6bq3gPGD/4ri6Eku5YABDbiK+L0vtCK4cWVvyQR2bwKCAQBDLHGUq1utR1GD23wH\nes6rZ6kA9xSz73e/+ezO/tN36bphPZllIq2jM1jpTLIANTHC00lizbEFtThxjuXt\n9XFwNMXVcL+JjXadeobWrw99XpG0y4KNU4xNL3PShyqBD1GOtObWuGgauHZCa716\nkcZbmU+Sl1hPzoKfM2oAyAzNk9pxWWhvkZN1Brt4FDF+BlVAyNMIWMgKq3JCPK2Z\niAQCWVFya2tJGDDFcejOpLd2lmXzIc5WRI5iG6soMVZCKg/0vD4kezrV0bmMHkJY\nmfEK8riPWsLKLQTZfD3okIuJisfZA7u/r03o/dnu4fpdg8UbvKKLU68vebDLIrBu\n/D/rAoIBABIEuSApQLlNbiE2zctbh0i2cqjWpts292S0hs+Yta9blZgo4TzM+Vjd\nQLxgKUNvfW31Lp4mgbWp7aGHDoaAK9CmhBiN2SsxvArgl7Q8L4sKlQqctCduug/0\n0Ql9lZsntQsP3PKReWZsCDV0bBJ/6iO8EwYvIOPkGYqIP8wnsV1KzIQl8y/RCLao\nJLWLqTL+sRLrk7Kj9KOx/yfV2Lqw/xR7z3pVFcvo/DkUhSImGYrbrcA79uufwVOm\n18GlC5cRMvc2hdCdujf0PYwUefIMIid7sXkk3OowHloTJn/2YX4Em3zR33saSWd9\nAp1ogAIgu/VXiWhac7EWtmnxl3ioeNkCggEAEsNwb2RY0tRZ37L+dWRA/uo5tWDG\njmYlqMO+tEMOP/LNPJmpOjCUsGuDtTw3ZUyv6YaAfTASguwkx9Iocna6MFylWQdg\nWywyIAmzLSi4tFZHJPhXV/otLjFQNVZvHqzWZzka2KhA0LVcLqrfx7PctwscZs3R\nUgSwlDFStiZAZH2eNcq8oEci3Fcqug+cHDuNeqrfhQSjOWVHXDUwXonp2zT9JnPb\nqiMOdybnZN3d1yKS7Vw0VSVm1G2iUEqMGgAbUWvNUg+Zxm5WSR7aG0Yj6JZPV7H5\nt4T07rMkzBNes1qUZShI0xTMr5fEj+8gZ9MQKlE9TEGJ8LQjarP5Zse9yA==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:57:18.510 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:57:19.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:19 smithi028 ceph-mon[31213]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:19.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:19.700 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:57:19.701 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial admin user... 2024-09-21T06:57:20.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:20 smithi028 ceph-mon[31213]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:20.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:20 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:21.173 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$A3giWhr6bMniu4rUZ0THp.LKohQvszoPJ16Dkd5iB1YzGkETWYFYa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726901840, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:57:21.174 INFO:teuthology.orchestra.run.smithi028.stdout:Fetching dashboard port number... 2024-09-21T06:57:21.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:21 smithi028 ceph-mon[31213]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:21.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:22.329 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:57:22.340 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:57:22.340 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-09-21T06:57:22.348 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:57:22.348 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-09-21T06:57:22.348 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-09-21T06:57:22.348 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout:Ceph Dashboard is now available at: 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout: URL: https://smithi028.front.sepia.ceph.com:8443/ 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout: User: admin 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout: Password: s89fmawgfr 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:22.350 INFO:teuthology.orchestra.run.smithi028.stdout:Saving cluster configuration to /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config directory 2024-09-21T06:57:22.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:22 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2544912940' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:57:23.661 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:57:23.661 INFO:teuthology.orchestra.run.smithi028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:57:23.661 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.661 INFO:teuthology.orchestra.run.smithi028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: ceph telemetry on 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout:For more information see: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:23.662 INFO:teuthology.orchestra.run.smithi028.stdout:Bootstrap complete. 2024-09-21T06:57:23.702 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:57:23.702 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:57:23.702 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:57:23.718 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:57:23.718 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:57:23.718 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:57:23.775 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:57:23.775 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:57:23.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:57:23.842 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:57:23.842 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:57:23.842 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:57:23.897 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:57:23.898 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:57:23.973 INFO:teuthology.orchestra.run.smithi028.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:23.984 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:57:24.026 INFO:teuthology.orchestra.run.smithi129.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:24.039 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:57:24.080 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIL3DONp82NtS3sfgjComIv6TjNsQ6fTs2v2XB6NaMGuL3cTlbEcv8XWSOl2zNZZwF8dGXZxhNcOauhbgbkGXM2El3IEXh4Jjcf7d9fV4HkDylD381KDJH9C/B3hvZbt4BXSWv2OMBXdyvdWhEFmejUO8K59FggAU9QpADcogLtrJk6Pub8D6M1mG3mY3vQSg0HrmYbr2sezsTpf5PT/CbOL3huP2q3B279qhWkxHPEahGSVoH7akJHx0IQwj/kioK5kXTiR05rb74bvKWSjwnUxGVYk9ddRWnTI13cFuJFjoq6S5b2Sv5mq6e7HxwWpMrb/H+m4wRb3jZZva4GthuCemrByIrj9B9PI5Vsz4VUMZpj5wkXVrJ9mVY7uJT29wvQNvBLAvxTjCdTRTV5Glq7Z+gURuKuAEKr5Q+arHodv0SrbTmwmj/v8lwzOIWVrbWlBO1QEvLVIPDxwXeYlJ8gb6LG9oQJMrvwW/SSBGW81wdsQw6pcWrJjRsnIpG/k= ceph-7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:24.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:57:24.212 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:24 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3029006897' entity='client.admin' 2024-09-21T06:57:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:25.757 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:57:25.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:57:26.421 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:26 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2464695065' entity='client.admin' 2024-09-21T06:57:26.421 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:26 smithi028 ceph-mon[31213]: mgrmap e13: x(active, since 12s) 2024-09-21T06:57:26.688 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:28.007 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi129 2024-09-21T06:57:28.007 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:57:28.008 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:57:28.028 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:57:28.028 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:28.086 INFO:tasks.cephadm:Adding host smithi129 to orchestrator... 2024-09-21T06:57:28.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch host add smithi129 2024-09-21T06:57:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:28.655 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:28 smithi028 ceph-mon[31213]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:28.655 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi028", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: Updating smithi028:/etc/ceph/ceph.conf 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: Updating smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: Updating smithi028:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: Updating smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:29.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:30.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:30 smithi028 ceph-mon[31213]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi129", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:31.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:31 smithi028 ceph-mon[31213]: Deploying cephadm binary to smithi129 2024-09-21T06:57:33.007 INFO:teuthology.orchestra.run.smithi028.stdout:Added host 'smithi129' with addr '172.21.15.129' 2024-09-21T06:57:33.595 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:33 smithi028 ceph-mon[31213]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:33.595 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:33.595 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:33.595 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:33.625 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:57:33.879 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:34.515 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:34.515 INFO:teuthology.orchestra.run.smithi028.stdout:[{"addr": "172.21.15.28", "hostname": "smithi028", "labels": [], "status": ""}, {"addr": "172.21.15.129", "hostname": "smithi129", "labels": [], "status": ""}] 2024-09-21T06:57:34.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:34 smithi028 ceph-mon[31213]: Added host smithi129 2024-09-21T06:57:34.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:34.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:35.178 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-09-21T06:57:35.178 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:57:35.178 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:57:35.197 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:57:35.197 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:35.256 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-09-21T06:57:35.256 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch host add smithi181 2024-09-21T06:57:35.519 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:35 smithi028 ceph-mon[31213]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:35 smithi028 ceph-mon[31213]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:37.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:37.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:37 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: Deploying cephadm binary to smithi181 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:39.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:38 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:39.983 INFO:teuthology.orchestra.run.smithi028.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-09-21T06:57:39.983 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:39 smithi028 ceph-mon[31213]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:40.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:57:40.958 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: Added host smithi181 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:41.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:41.611 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:57:41.611 INFO:teuthology.orchestra.run.smithi028.stdout:[{"addr": "172.21.15.28", "hostname": "smithi028", "labels": [], "status": ""}, {"addr": "172.21.15.129", "hostname": "smithi129", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-09-21T06:57:42.229 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:57:42.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:57:42.484 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:57:42.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:42 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:42.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:42 smithi028 ceph-mon[31213]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:43.299 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-09-21T06:57:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:43 smithi028 ceph-mon[31213]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:43 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:57:44.061 INFO:tasks.cephadm:Adding mon.a on smithi028 2024-09-21T06:57:44.061 INFO:tasks.cephadm:Adding mon.b on smithi129 2024-09-21T06:57:44.061 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-09-21T06:57:44.061 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c' 2024-09-21T06:57:44.335 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T06:57:44.379 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:44.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:44 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:45.110 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-09-21T06:57:45.719 DEBUG:teuthology.orchestra.run.smithi129:mon.b> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:57:45.722 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:57:45.725 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:57:45.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:57:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:57:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:46.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:45 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:46 smithi028 ceph-mon[31213]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:46 smithi028 ceph-mon[31213]: Saving service mon spec with placement smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c;count:3 2024-09-21T06:57:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:46 smithi028 ceph-mon[31213]: Deploying daemon mon.c on smithi181 2024-09-21T06:57:47.468 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:48.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:47 smithi028 ceph-mon[31213]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:57:48.689 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T06:56:19.738103Z","created":"2024-09-21T06:56:19.738103Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:57:48.689 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-09-21T06:57:49.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:48 smithi181 systemd[1]: Starting Ceph mon.c for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:57:49.562 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 podman[34666]: 2024-09-21 06:57:49.435054175 +0000 UTC m=+0.098015781 container create 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:57:49.562 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 podman[34666]: 2024-09-21 06:57:49.352518465 +0000 UTC m=+0.015480080 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:57:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 podman[34666]: 2024-09-21 06:57:49.64594968 +0000 UTC m=+0.308911299 container init 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:57:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 podman[34666]: 2024-09-21 06:57:49.649037805 +0000 UTC m=+0.311999411 container start 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:57:50.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:57:50.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pidfile_write: ignore empty --pid-file 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: load: jerasure load: lrc 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Git sha 0 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: DB SUMMARY 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: DB Session ID: FT8S2QZ8D2YUA9E0HVM9 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T06:57:50.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.env: 0x556ce8911d60 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.info_log: 0x556cee7bb360 2024-09-21T06:57:50.023 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.statistics: (nil) 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.use_fsync: 0 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:57:50.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.db_log_dir: 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.wal_dir: 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:57:50.026 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.write_buffer_manager: 0x556cee7bfd60 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.unordered_write: 0 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:57:50.027 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.row_cache: None 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.wal_filter: None 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.wal_compression: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:57:50.028 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:57:50.029 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_open_files: -1 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Compression algorithms supported: 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kZSTD supported: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:57:50.030 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.merge_operator: 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_filter: None 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556cee7bafa0) 2024-09-21T06:57:50.031 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_type: 0 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_index_type: 0 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_shortening: 1 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: checksum: 4 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: no_block_cache: 0 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache: 0x556cea77f610 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_options: 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: capacity : 536870912 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_shard_bits : 4 2024-09-21T06:57:50.032 INFO:journalctl@ceph.mon.c.smithi181.stdout: strict_capacity_limit : 0 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_compressed: (nil) 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: persistent_cache: (nil) 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size: 4096 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size_deviation: 10 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_restart_interval: 16 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_block_restart_interval: 1 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: metadata_block_size: 4096 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: partition_filters: 0 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: use_delta_encoding: 1 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: filter_policy: bloomfilter 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: whole_key_filtering: 1 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: verify_compression: 0 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:57:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout: format_version: 5 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_index_compression: 1 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_align: 0 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: max_auto_readahead_size: 262144 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: prepopulate_block_cache: 0 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression: NoCompression 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.num_levels: 7 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:57:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:57:50.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:57:50.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:57:50.037 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:57:50.038 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.ttl: 2592000 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:57:50.039 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5a2fd8d0-0820-40e8-a272-15a8f48dd2b2 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901869687260, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901869687855, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726901869, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5a2fd8d0-0820-40e8-a272-15a8f48dd2b2", "db_session_id": "FT8S2QZ8D2YUA9E0HVM9", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901869687984, "job": 1, "event": "recovery_finished"} 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556cee7dea80 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: DB pointer 0x556cef584000 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:57:50.040 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** DB Stats ** 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:57:50.041 INFO:journalctl@ceph.mon.c.smithi181.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:57:50.042 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache BinnedLRUCache@0x556cea77f610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: using public_addr v2:172.21.15.181:0/0 -> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T06:57:50.043 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: starting mon.c rank -1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:50.044 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(???) e0 preinit fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:50.044 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T06:57:50.044 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T06:57:50.044 INFO:journalctl@ceph.mon.c.smithi181.stdout: e1 2024-09-21T06:57:50.044 INFO:journalctl@ceph.mon.c.smithi181.stdout: btime 2024-09-21T06:56:23:464631+0000 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout: legacy client fscid: -1 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout: No filesystems configured 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:57:50.045 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.046 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Deploying cephadm binary to smithi181 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.047 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Added host smithi181 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.048 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:50.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Saving service mon spec with placement smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c;count:3 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: Deploying daemon mon.c on smithi181 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/1383141046' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 ceph-mon[34686]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 bash[34666]: 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 2024-09-21T06:57:50.050 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:49 smithi181 systemd[1]: Started Ceph mon.c for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:57:50.051 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:49 smithi028 ceph-mon[31213]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:50.051 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:49 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/1383141046' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:50.298 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:57:50.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: mon.a calling monitor election 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: mon.c calling monitor election 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: monmap epoch 2 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: last_changed 2024-09-21T06:57:49.717463+0000 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: min_mon_release 19 (squid) 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: election_strategy: 1 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:57:55.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: fsmap 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: mgrmap e13: x(active, since 42s) 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: overall HEALTH_OK 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:55.050 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:54 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:55.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: mon.a calling monitor election 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: mon.c calling monitor election 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:55.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: monmap epoch 2 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: last_changed 2024-09-21T06:57:49.717463+0000 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: min_mon_release 19 (squid) 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: election_strategy: 1 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: fsmap 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: mgrmap e13: x(active, since 42s) 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: overall HEALTH_OK 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:55.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:55.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:54 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:55.662 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:57:55.662 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T06:57:49.717463Z","created":"2024-09-21T06:56:19.738103Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:57:55.663 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-21T06:57:56.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:55 smithi181 ceph-mon[34686]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:56.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:55 smithi181 ceph-mon[34686]: Deploying daemon mon.b on smithi129 2024-09-21T06:57:56.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:55 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/4083155130' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:56.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:56.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:55 smithi028 ceph-mon[31213]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:56.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:55 smithi028 ceph-mon[31213]: Deploying daemon mon.b on smithi129 2024-09-21T06:57:56.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:55 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/4083155130' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:56.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:57.339 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:57:57.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:57:57.586 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:57:58.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:57:57 smithi181 ceph-mon[34686]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:57:57 smithi028 ceph-mon[31213]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.306 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 podman[34845]: 2024-09-21 06:57:58.273034683 +0000 UTC m=+0.332718889 container start 9250081be069202265f2e649c32116a659235a890b8ddbd4ff4d73ae93c32991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:57:58.306 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:57:58.306 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:57:58.306 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pidfile_write: ignore empty --pid-file 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: load: jerasure load: lrc 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Git sha 0 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: DB SUMMARY 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: DB Session ID: Q9Z24S7EOREQIUYSEXSN 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:57:58.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.env: 0x55fa2ed10d60 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.info_log: 0x55fa34377360 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.statistics: (nil) 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.use_fsync: 0 2024-09-21T06:57:58.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.db_log_dir: 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.wal_dir: 2024-09-21T06:57:58.609 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:57:58.610 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:57:58.610 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:57:58.610 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:57:58.611 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:57:58.611 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:57:58.611 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:57:58.611 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:57:58.611 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.write_buffer_manager: 0x55fa3437bd60 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.unordered_write: 0 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:57:58.612 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:57:58.613 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.row_cache: None 2024-09-21T06:57:58.613 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.wal_filter: None 2024-09-21T06:57:58.613 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:57:58.613 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:57:58.613 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.wal_compression: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:57:58.614 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_open_files: -1 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:57:58.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Compression algorithms supported: 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kZSTD supported: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T06:57:58.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.merge_operator: 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_filter: None 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa34376fa0) 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: index_type: 0 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: data_block_index_type: 0 2024-09-21T06:57:58.617 INFO:journalctl@ceph.mon.b.smithi129.stdout: index_shortening: 1 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: checksum: 4 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: no_block_cache: 0 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_cache: 0x55fa3033b610 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_cache_options: 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: capacity : 536870912 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: num_shard_bits : 4 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: strict_capacity_limit : 0 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_cache_compressed: (nil) 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: persistent_cache: (nil) 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_size: 4096 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_size_deviation: 10 2024-09-21T06:57:58.618 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_restart_interval: 16 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: index_block_restart_interval: 1 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: metadata_block_size: 4096 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: partition_filters: 0 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: use_delta_encoding: 1 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: filter_policy: bloomfilter 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: whole_key_filtering: 1 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: verify_compression: 0 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: format_version: 5 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: enable_index_compression: 1 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: block_align: 0 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: max_auto_readahead_size: 262144 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: prepopulate_block_cache: 0 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:57:58.619 INFO:journalctl@ceph.mon.b.smithi129.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression: NoCompression 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.num_levels: 7 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:57:58.620 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:57:58.621 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:57:58.622 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:57:58.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.ttl: 2592000 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:57:58.624 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e6a3935f-4f84-4012-a510-09e25fbcb582 2024-09-21T06:57:58.625 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901878310991, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901878311473, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726901878, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e6a3935f-4f84-4012-a510-09e25fbcb582", "db_session_id": "Q9Z24S7EOREQIUYSEXSN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901878311572, "job": 1, "event": "recovery_finished"} 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fa3439aa80 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: DB pointer 0x55fa35140000 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout: ** DB Stats ** 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:58.626 INFO:journalctl@ceph.mon.b.smithi129.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: ** Compaction Stats [default] ** 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: ** Compaction Stats [default] ** 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:57:58.627 INFO:journalctl@ceph.mon.b.smithi129.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Block cache BinnedLRUCache@0x55fa3033b610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:57:58.628 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: using public_addr v2:172.21.15.129:0/0 -> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: starting mon.b rank -1 at public addrs [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] at bind addrs [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(???) e0 preinit fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 bash[34845]: 9250081be069202265f2e649c32116a659235a890b8ddbd4ff4d73ae93c32991 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 systemd[1]: Started Ceph mon.b for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: e1 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: btime 2024-09-21T06:56:23:464631+0000 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:57:58.629 INFO:journalctl@ceph.mon.b.smithi129.stdout: legacy client fscid: -1 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout: 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout: No filesystems configured 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:58.630 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi129", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Deploying cephadm binary to smithi181 2024-09-21T06:57:58.631 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi129:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Added host smithi181 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.632 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3547987332' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:57:58.633 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Saving service mon spec with placement smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c;count:3 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Deploying daemon mon.c on smithi181 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.634 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/1383141046' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.a calling monitor election 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.c calling monitor election 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:57:58.635 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: monmap epoch 2 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: last_changed 2024-09-21T06:57:49.717463+0000 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: min_mon_release 19 (squid) 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: election_strategy: 1 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: fsmap 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mgrmap e13: x(active, since 42s) 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: overall HEALTH_OK 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:57:58.636 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: Deploying daemon mon.b on smithi129 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/4083155130' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:57:58.637 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:57:58 smithi129 ceph-mon[34863]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:58:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:58:03.359 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T06:57:58.340407Z","created":"2024-09-21T06:56:19.738103Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:3300","nonce":0},{"type":"v1","addr":"172.21.15.129:6789","nonce":0}]},"addr":"172.21.15.129:6789/0","public_addr":"172.21.15.129:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T06:58:03.359 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: mon.a calling monitor election 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: mon.c calling monitor election 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/1113180514' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.668 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: mon.b calling monitor election 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: monmap epoch 3 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: last_changed 2024-09-21T06:57:58.340407+0000 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: min_mon_release 19 (squid) 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: election_strategy: 1 2024-09-21T06:58:03.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: 2: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.b 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: fsmap 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: mgrmap e13: x(active, since 51s) 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: overall HEALTH_OK 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.670 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: mon.a calling monitor election 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: mon.c calling monitor election 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/1113180514' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: mon.b calling monitor election 2024-09-21T06:58:03.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: monmap epoch 3 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: last_changed 2024-09-21T06:57:58.340407+0000 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: min_mon_release 19 (squid) 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: election_strategy: 1 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: 2: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.b 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: fsmap 2024-09-21T06:58:03.735 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: mgrmap e13: x(active, since 51s) 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: overall HEALTH_OK 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.736 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: mon.a calling monitor election 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: mon.c calling monitor election 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/1113180514' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: mon.b calling monitor election 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: monmap epoch 3 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: last_changed 2024-09-21T06:57:58.340407+0000 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: created 2024-09-21T06:56:19.738103+0000 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: min_mon_release 19 (squid) 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: election_strategy: 1 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-21T06:58:03.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: 2: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.b 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: fsmap 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: mgrmap e13: x(active, since 51s) 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: overall HEALTH_OK 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:03.986 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:58:03.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:58:04.246 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:04.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:04.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:04.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:04.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:04.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:04.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:58:05.108 INFO:teuthology.orchestra.run.smithi028.stdout:# minimal ceph.conf for 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:05.109 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-09-21T06:58:05.109 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:05.109 INFO:teuthology.orchestra.run.smithi028.stdout: mon_host = [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T06:58:05.711 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi028:/etc/ceph/ceph.conf 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.712 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: Updating smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3542396186' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.713 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.714 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:05.714 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:05.714 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi028:/etc/ceph/ceph.conf 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:58:05.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: Updating smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.735 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3542396186' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.736 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.736 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.736 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:05.736 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:05.736 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.738 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:58:05.739 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:58:05.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:58:05.767 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:58:05.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:58:05.833 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:58:05.833 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi028:/etc/ceph/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi129:/etc/ceph/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: Updating smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3542396186' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:05.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:05.863 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:58:05.863 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:58:05.930 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:58:05.930 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:58:05.957 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:58:05.957 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:58:06.022 INFO:tasks.cephadm:Adding mgr.x on smithi028 2024-09-21T06:58:06.022 INFO:tasks.cephadm:Adding mgr.y on smithi129 2024-09-21T06:58:06.022 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-09-21T06:58:06.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi028=x;smithi129=y;smithi181=z' 2024-09-21T06:58:06.308 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:58:06.683 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:06 smithi181 ceph-mon[34686]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:58:06.683 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:06 smithi181 ceph-mon[34686]: Reconfiguring daemon mon.a on smithi028 2024-09-21T06:58:06.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:06 smithi028 ceph-mon[31213]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:58:06.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:06 smithi028 ceph-mon[31213]: Reconfiguring daemon mon.a on smithi028 2024-09-21T06:58:06.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:06 smithi129 ceph-mon[34863]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:58:06.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:06 smithi129 ceph-mon[34863]: Reconfiguring daemon mon.a on smithi028 2024-09-21T06:58:06.980 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-09-21T06:58:07.556 DEBUG:teuthology.orchestra.run.smithi129:mgr.y> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:58:07.559 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:58:07.561 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:58:07.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:58:07.564 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:58:07.564 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:58:07.608 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:58:07.608 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:58:07.651 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:58:07.651 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:58:07.694 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:58:07.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:58:07.737 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:58:07.737 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:58:07.780 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:58:07.780 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:58:07.823 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:58:07.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:58:07.867 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:58:07.867 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:58:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:07.902 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:58:07.902 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:58:07.956 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:58:07.956 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:58:07.957 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:07.999 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:58:07.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:58:08.042 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:58:08.042 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:58:08.085 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:58:08.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:58:08.135 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:58:08.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: Reconfiguring daemon mon.b on smithi129 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.163 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.170 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:58:08.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:58:08.226 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:58:08.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:08.262 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:08.263 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:08.263 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: Reconfiguring daemon mon.b on smithi129 2024-09-21T06:58:08.263 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.263 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:58:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: Reconfiguring daemon mon.b on smithi129 2024-09-21T06:58:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:08.285 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:58:08.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:58:08.338 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:58:08.339 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:58:08.383 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:58:08.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:58:08.429 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:58:08.430 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:58:08.476 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:58:08.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:58:08.520 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:58:08.520 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:58:08.573 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:58:08.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:58:08.624 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:58:08.624 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:58:08.674 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:58:08.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:58:08.724 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T06:58:08.724 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi028') 2024-09-21T06:58:09.039 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi129=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: Saving service mgr spec with placement smithi028=x;smithi129=y;smithi181=z;count:3 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:09.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi129=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:09.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: Saving service mgr spec with placement smithi028=x;smithi129=y;smithi181=z;count:3 2024-09-21T06:58:09.118 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.118 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.118 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:09.118 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:09.118 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi129=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: Saving service mgr spec with placement smithi028=x;smithi129=y;smithi181=z;count:3 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:58:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:09.970 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: Reconfiguring daemon mon.c on smithi181 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1209365205' entity='client.admin' 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:10.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:10.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:10.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:09 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2939607674' entity='client.admin' 2024-09-21T06:58:10.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: Reconfiguring daemon mon.c on smithi181 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1209365205' entity='client.admin' 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:10.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:09 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2939607674' entity='client.admin' 2024-09-21T06:58:10.322 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:10.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: Reconfiguring daemon mon.c on smithi181 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1209365205' entity='client.admin' 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:09 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2939607674' entity='client.admin' 2024-09-21T06:58:10.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi028') 2024-09-21T06:58:10.813 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi028') 2024-09-21T06:58:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.002 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.005 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.005 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.005 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.005 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.010 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.010 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:11.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:10 smithi028 ceph-mon[31213]: Deploying daemon mgr.z on smithi181 2024-09-21T06:58:11.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:10 smithi181 ceph-mon[34686]: Deploying daemon mgr.z on smithi181 2024-09-21T06:58:11.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:10 smithi129 ceph-mon[34863]: Deploying daemon mgr.z on smithi181 2024-09-21T06:58:11.769 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 06:58:11 smithi181 systemd[1]: Started Ceph mgr.z for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4248687503' entity='client.admin' 2024-09-21T06:58:12.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:11 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2922384119' entity='client.admin' 2024-09-21T06:58:12.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:12.203 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.203 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.203 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4248687503' entity='client.admin' 2024-09-21T06:58:12.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:11 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2922384119' entity='client.admin' 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:12.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4248687503' entity='client.admin' 2024-09-21T06:58:12.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:11 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2922384119' entity='client.admin' 2024-09-21T06:58:12.888 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:12.888 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:12.889 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:12.891 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:12.964 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:12 smithi129 ceph-mon[34863]: Deploying daemon mgr.y on smithi129 2024-09-21T06:58:12.984 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:12 smithi028 ceph-mon[31213]: Deploying daemon mgr.y on smithi129 2024-09-21T06:58:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:12 smithi181 ceph-mon[34686]: Deploying daemon mgr.y on smithi129 2024-09-21T06:58:13.344 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 systemd[1]: Starting Ceph mgr.y for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:58:13.599 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 podman[35662]: 2024-09-21 06:58:13.245819888 +0000 UTC m=+0.015873989 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:58:13.599 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 podman[35662]: 2024-09-21 06:58:13.372855765 +0000 UTC m=+0.142909849 container create b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:58:13.599 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 podman[35662]: 2024-09-21 06:58:13.597705708 +0000 UTC m=+0.367759790 container init b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:58:13.856 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 podman[35662]: 2024-09-21 06:58:13.600848553 +0000 UTC m=+0.370902636 container start b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:58:13.857 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mgr[35681]: -- 172.21.15.129:0/3655214082 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55943f1650e0 con 0x559443f08480 2024-09-21T06:58:13.857 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 bash[35662]: b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 2024-09-21T06:58:13.857 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 06:58:13 smithi129 systemd[1]: Started Ceph mgr.y for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2961960164' entity='client.admin' 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2326997958' entity='client.admin' 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:13.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:13.977 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2961960164' entity='client.admin' 2024-09-21T06:58:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2326997958' entity='client.admin' 2024-09-21T06:58:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:14.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2961960164' entity='client.admin' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2326997958' entity='client.admin' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:15.534 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1701709799' entity='client.admin' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2288859539' entity='client.admin' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:15.535 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.536 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:15 smithi028 ceph-mon[31213]: Reconfiguring daemon mgr.x on smithi028 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1701709799' entity='client.admin' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2288859539' entity='client.admin' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:58:15.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:15.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:15.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:15 smithi129 ceph-mon[34863]: Reconfiguring daemon mgr.x on smithi028 2024-09-21T06:58:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1701709799' entity='client.admin' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2288859539' entity='client.admin' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:15 smithi181 ceph-mon[34686]: Reconfiguring daemon mgr.x on smithi028 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1373457440' entity='client.admin' 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='client.? ' entity='client.admin' 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: Standby manager daemon z started 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:58:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:16 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:16.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1373457440' entity='client.admin' 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='client.? ' entity='client.admin' 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: Standby manager daemon z started 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:58:16.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:16 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1373457440' entity='client.admin' 2024-09-21T06:58:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='client.? ' entity='client.admin' 2024-09-21T06:58:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: Standby manager daemon z started 2024-09-21T06:58:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:58:17.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:17.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:58:17.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:16 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.181:0/3436397127' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:18.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:17 smithi181 ceph-mon[34686]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:18.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:17 smithi181 ceph-mon[34686]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:58:18.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:58:18.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:17 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3861595235' entity='client.admin' 2024-09-21T06:58:18.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:17 smithi028 ceph-mon[31213]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:17 smithi028 ceph-mon[31213]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:58:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:58:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:17 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3861595235' entity='client.admin' 2024-09-21T06:58:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:18.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:17 smithi129 ceph-mon[34863]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:18.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:17 smithi129 ceph-mon[34863]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:58:18.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:58:18.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:17 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3861595235' entity='client.admin' 2024-09-21T06:58:18.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:19.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/312278308' entity='client.admin' 2024-09-21T06:58:19.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: Standby manager daemon y started 2024-09-21T06:58:19.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:58:19.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:19.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:58:19.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:18 smithi181 ceph-mon[34686]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/312278308' entity='client.admin' 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: Standby manager daemon y started 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:58:19.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:18 smithi028 ceph-mon[31213]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:19.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/312278308' entity='client.admin' 2024-09-21T06:58:19.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: Standby manager daemon y started 2024-09-21T06:58:19.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:58:19.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:58:19.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:58:19.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:18 smithi129 ceph-mon[34863]: from='mgr.? 172.21.15.129:0/2487767148' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:58:19.275 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:19.906 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:19 smithi028 ceph-mon[31213]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:19.906 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:19 smithi028 ceph-mon[31213]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:58:19.906 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:58:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:19 smithi181 ceph-mon[34686]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:19 smithi181 ceph-mon[34686]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:58:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:58:20.102 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:20.102 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:20.103 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:20.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:19 smithi129 ceph-mon[34863]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:20.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:19 smithi129 ceph-mon[34863]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:58:20.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:58:21.589 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:21 smithi028 ceph-mon[31213]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:21.589 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:21 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1184775282' entity='client.admin' 2024-09-21T06:58:21.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:21 smithi129 ceph-mon[34863]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:21.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:21 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1184775282' entity='client.admin' 2024-09-21T06:58:21.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:21 smithi181 ceph-mon[34686]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:21.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:21 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1184775282' entity='client.admin' 2024-09-21T06:58:22.665 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9000b6480 msgr2=0x7fc9000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9000b6480 0x7fc9000b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc910009230 tx=0x7fc9100058d0 comp rx=0 tx=0).stop 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc918104070 msgr2=0x7fc9181a1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc918104070 0x7fc9181a1100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc90800cce0 tx=0x7fc90800a620 comp rx=0 tx=0).stop 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 shutdown_connections 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9000b6480 0x7fc9000b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc918104070 0x7fc9181a1100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9181036d0 0x7fc91819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 --2- 172.21.15.28:0/977256642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc918102640 0x7fc91806b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 >> 172.21.15.28:0/977256642 conn(0x7fc9180fdfb0 msgr2=0x7fc9181069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 shutdown_connections 2024-09-21T06:58:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.218+0000 7fc91f4ff640 1 -- 172.21.15.28:0/977256642 wait complete. 2024-09-21T06:58:23.746 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:23 smithi028 ceph-mon[31213]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:23.746 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:23 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/378787364' entity='client.admin' 2024-09-21T06:58:23.746 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:23 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/977256642' entity='client.admin' 2024-09-21T06:58:24.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:23 smithi181 ceph-mon[34686]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:24.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:23 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/378787364' entity='client.admin' 2024-09-21T06:58:24.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:23 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/977256642' entity='client.admin' 2024-09-21T06:58:24.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:23 smithi129 ceph-mon[34863]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:24.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:23 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/378787364' entity='client.admin' 2024-09-21T06:58:24.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:23 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/977256642' entity='client.admin' 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 -- 172.21.15.28:0/2094730753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 msgr2=0x7f8798102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 --2- 172.21.15.28:0/2094730753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798102ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8794009900 tx=0x7f879402a480 comp rx=0 tx=0).stop 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 -- 172.21.15.28:0/2094730753 shutdown_connections 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 --2- 172.21.15.28:0/2094730753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 0x7f879810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 --2- 172.21.15.28:0/2094730753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 0x7f8798103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 --2- 172.21.15.28:0/2094730753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798102ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 -- 172.21.15.28:0/2094730753 >> 172.21.15.28:0/2094730753 conn(0x7f87980fdfb0 msgr2=0x7f8798100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 -- 172.21.15.28:0/2094730753 shutdown_connections 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.744+0000 7f87a033e640 1 -- 172.21.15.28:0/2094730753 wait complete. 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 Processor -- start 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 -- start start 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 0x7f8798104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 0x7f8798105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f879810e120 con 0x7f8798102640 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f879810dfa0 con 0x7f87981036d0 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f87a033e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f879810e2a0 con 0x7f8798104070 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41312/0 (socket says 172.21.15.28:41312) 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 -- 172.21.15.28:0/3865086793 learned_addr learned my addr 172.21.15.28:0/3865086793 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:24.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e8db640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 0x7f8798105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879d8d9640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 0x7f8798104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 -- 172.21.15.28:0/3865086793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 msgr2=0x7f8798105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 0x7f8798105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 -- 172.21.15.28:0/3865086793 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 msgr2=0x7f8798104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 0x7f8798104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.745+0000 7f879e0da640 1 -- 172.21.15.28:0/3865086793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8798105740 con 0x7f8798102640 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f879e0da640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8794005790 tx=0x7f87940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879403f030 con 0x7f8798102640 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8794003c90 con 0x7f8798102640 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87981a3f60 con 0x7f8798102640 2024-09-21T06:58:24.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794035070 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.746+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87981a4300 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.747+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8798102ab0 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.749+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f8794042030 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.750+0000 7f878f7fe640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 0x7f87840b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.750+0000 7f879d8d9640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 0x7f87840b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.750+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f87941061b0 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.750+0000 7f879d8d9640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 0x7f87840b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8788009bd0 tx=0x7f8788005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.753+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87940d2af0 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.947+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f87981a44d0 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.947+0000 7f878f7fe640 1 -- 172.21.15.28:0/3865086793 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v24)=0 v24) ==== 108+0+0 (secure 0 0 0) 0x7f87940d7a30 con 0x7f8798102640 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 msgr2=0x7f87840b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 0x7f87840b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8788009bd0 tx=0x7f8788005f90 comp rx=0 tx=0).stop 2024-09-21T06:58:24.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 msgr2=0x7f8798106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8794005790 tx=0x7f87940042f0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 shutdown_connections 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b6500 0x7f87840b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8798104070 0x7f8798105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981036d0 0x7f8798104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 --2- 172.21.15.28:0/3865086793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8798102640 0x7f8798106230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.949+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 >> 172.21.15.28:0/3865086793 conn(0x7f87980fdfb0 msgr2=0x7f87980ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.950+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 shutdown_connections 2024-09-21T06:58:24.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.950+0000 7f87a033e640 1 -- 172.21.15.28:0/3865086793 wait complete. 2024-09-21T06:58:25.238 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:25 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/37359656' entity='client.admin' 2024-09-21T06:58:25.238 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:25 smithi028 ceph-mon[31213]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:25.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:25 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/37359656' entity='client.admin' 2024-09-21T06:58:25.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:25 smithi129 ceph-mon[34863]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:25.376 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi028') 2024-09-21T06:58:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 -- 172.21.15.28:0/1567905912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc201094a0 msgr2=0x7fdc2010b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 --2- 172.21.15.28:0/1567905912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc201094a0 0x7fdc2010b9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009ca0 tx=0x7fdc1802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 -- 172.21.15.28:0/1567905912 shutdown_connections 2024-09-21T06:58:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 --2- 172.21.15.28:0/1567905912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc201094a0 0x7fdc2010b9b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 --2- 172.21.15.28:0/1567905912 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc20106900 0x7fdc20108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 --2- 172.21.15.28:0/1567905912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc2006c660 0x7fdc201063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 -- 172.21.15.28:0/1567905912 >> 172.21.15.28:0/1567905912 conn(0x7fdc200fdfe0 msgr2=0x7fdc20100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 -- 172.21.15.28:0/1567905912 shutdown_connections 2024-09-21T06:58:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.440+0000 7fdc28337640 1 -- 172.21.15.28:0/1567905912 wait complete. 2024-09-21T06:58:25.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 Processor -- start 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 -- start start 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc2006c660 0x7fdc20199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 0x7fdc2019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2010f260 con 0x7fdc20106900 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2010f0e0 con 0x7fdc2006c660 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc28337640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2010f3e0 con 0x7fdc201094a0 2024-09-21T06:58:25.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41346/0 (socket says 172.21.15.28:41346) 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 -- 172.21.15.28:0/3213921609 learned_addr learned my addr 172.21.15.28:0/3213921609 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc268d4640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 0x7fdc2019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc260d3640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc2006c660 0x7fdc20199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 -- 172.21.15.28:0/3213921609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 msgr2=0x7fdc2019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 0x7fdc2019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 -- 172.21.15.28:0/3213921609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc2006c660 msgr2=0x7fdc20199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc2006c660 0x7fdc20199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc258d2640 1 -- 172.21.15.28:0/3213921609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2019b8c0 con 0x7fdc20106900 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.441+0000 7fdc268d4640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 0x7fdc2019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:58:25.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc258d2640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000d950 tx=0x7fdc1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10017030 con 0x7fdc20106900 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdc10004020 con 0x7fdc20106900 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2019bbb0 con 0x7fdc20106900 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100055e0 con 0x7fdc20106900 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.442+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc201a22b0 con 0x7fdc20106900 2024-09-21T06:58:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.443+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc20106d50 con 0x7fdc20106900 2024-09-21T06:58:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.445+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fdc10009a30 con 0x7fdc20106900 2024-09-21T06:58:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.445+0000 7fdc177fe640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 0x7fdc0c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.446+0000 7fdc260d3640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 0x7fdc0c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.446+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdc100e4ff0 con 0x7fdc20106900 2024-09-21T06:58:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.446+0000 7fdc260d3640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 0x7fdc0c0b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c005d00 tx=0x7fdc1c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.450+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc100ad550 con 0x7fdc20106900 2024-09-21T06:58:25.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:25 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/37359656' entity='client.admin' 2024-09-21T06:58:25.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:25 smithi181 ceph-mon[34686]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.642+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fdc20063fc0 con 0x7fdc20106900 2024-09-21T06:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.646+0000 7fdc177fe640 1 -- 172.21.15.28:0/3213921609 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fdc100b1930 con 0x7fdc20106900 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 msgr2=0x7fdc0c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 0x7fdc0c0b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c005d00 tx=0x7fdc1c005c50 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 msgr2=0x7fdc2019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000d950 tx=0x7fdc1000de10 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 shutdown_connections 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdc0c0b6500 0x7fdc0c0b8a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc201094a0 0x7fdc2019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc20106900 0x7fdc2019a500 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 --2- 172.21.15.28:0/3213921609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc2006c660 0x7fdc20199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 >> 172.21.15.28:0/3213921609 conn(0x7fdc200fdfe0 msgr2=0x7fdc20104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 shutdown_connections 2024-09-21T06:58:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:25.649+0000 7fdc28337640 1 -- 172.21.15.28:0/3213921609 wait complete. 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/256691271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 msgr2=0x7fb8cc101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/256691271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc101f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009900 tx=0x7fb8c802a410 comp rx=0 tx=0).stop 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/256691271 shutdown_connections 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/256691271 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc109470 0x7fb8cc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/256691271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc102530 0x7fb8cc108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/256691271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc101f10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/256691271 >> 172.21.15.28:0/256691271 conn(0x7fb8cc0fd770 msgr2=0x7fb8cc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/256691271 shutdown_connections 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.862+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/256691271 wait complete. 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 Processor -- start 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 -- start start 2024-09-21T06:58:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 0x7fb8cc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 0x7fb8cc19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10f260 con 0x7fb8cc101b00 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10f0e0 con 0x7fb8cc109470 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d3e8b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10f3e0 con 0x7fb8cc102530 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d1c27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d1c27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41336/0 (socket says 172.21.15.28:41336) 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.863+0000 7fb8d1c27640 1 -- 172.21.15.28:0/37359656 learned_addr learned my addr 172.21.15.28:0/37359656 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1426640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 0x7fb8cc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d2428640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 0x7fb8cc19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 -- 172.21.15.28:0/37359656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 msgr2=0x7fb8cc19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 0x7fb8cc19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 -- 172.21.15.28:0/37359656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 msgr2=0x7fb8cc19b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 0x7fb8cc19b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 -- 172.21.15.28:0/37359656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc19b8e0 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d2428640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 0x7fb8cc19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1426640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 0x7fb8cc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d1c27640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8031440 tx=0x7fb8c8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c803f070 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb8c8031b80 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc19bb70 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8035030 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.864+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc1a2100 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.865+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc101f10 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.867+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb8c8042070 con 0x7fb8cc101b00 2024-09-21T06:58:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.868+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 0x7fb8b80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.869+0000 7fb8d1426640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 0x7fb8b80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.869+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb8c81067d0 con 0x7fb8cc101b00 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.869+0000 7fb8d1426640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 0x7fb8b80b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc005d00 tx=0x7fb8bc005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:23.871+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8c80cec90 con 0x7fb8cc101b00 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.066+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb8cc02e640 con 0x7fb8cc101b00 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.070+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/37359656 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7fb8c80d3070 con 0x7fb8cc101b00 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 msgr2=0x7fb8b80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 0x7fb8b80b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc005d00 tx=0x7fb8bc005c70 comp rx=0 tx=0).stop 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 msgr2=0x7fb8cc199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8031440 tx=0x7fb8c8003c10 comp rx=0 tx=0).stop 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 shutdown_connections 2024-09-21T06:58:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb8b80b6480 0x7fb8b80b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8cc109470 0x7fb8cc19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8cc102530 0x7fb8cc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 --2- 172.21.15.28:0/37359656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc101b00 0x7fb8cc199eb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 >> 172.21.15.28:0/37359656 conn(0x7fb8cc0fd770 msgr2=0x7fb8cc10a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 shutdown_connections 2024-09-21T06:58:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:24.072+0000 7fb8d3e8b640 1 -- 172.21.15.28:0/37359656 wait complete. 2024-09-21T06:58:26.957 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:26 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3213921609' entity='client.admin' 2024-09-21T06:58:27.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:26 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3213921609' entity='client.admin' 2024-09-21T06:58:27.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:26 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3213921609' entity='client.admin' 2024-09-21T06:58:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:27 smithi129 ceph-mon[34863]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:27.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:27.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:27.921 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:27.921 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:28.013 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:27 smithi028 ceph-mon[31213]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:28.013 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:28.013 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:28.013 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:27 smithi181 ceph-mon[34686]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:28.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:28.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:28.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 -- 172.21.15.28:0/816651331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 msgr2=0x7fba54104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 --2- 172.21.15.28:0/816651331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba54104bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba44009900 tx=0x7fba4402a480 comp rx=0 tx=0).stop 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 -- 172.21.15.28:0/816651331 shutdown_connections 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 --2- 172.21.15.28:0/816651331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 --2- 172.21.15.28:0/816651331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba54104bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 --2- 172.21.15.28:0/816651331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 0x7fba54103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 -- 172.21.15.28:0/816651331 >> 172.21.15.28:0/816651331 conn(0x7fba540ff0c0 msgr2=0x7fba54101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 -- 172.21.15.28:0/816651331 shutdown_connections 2024-09-21T06:58:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.889+0000 7fba5b94c640 1 -- 172.21.15.28:0/816651331 wait complete. 2024-09-21T06:58:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 Processor -- start 2024-09-21T06:58:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 -- start start 2024-09-21T06:58:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 0x7fba54199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba5410f2b0 con 0x7fba541047e0 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fba5410f130 con 0x7fba54105180 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.890+0000 7fba5b94c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba5410f430 con 0x7fba54103750 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41368/0 (socket says 172.21.15.28:41368) 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 -- 172.21.15.28:0/603034513 learned_addr learned my addr 172.21.15.28:0/603034513 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba59ee9640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba596e8640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 0x7fba54199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 -- 172.21.15.28:0/603034513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 msgr2=0x7fba54199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 0x7fba54199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 -- 172.21.15.28:0/603034513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 msgr2=0x7fba5419b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5419b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 -- 172.21.15.28:0/603034513 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5419b920 con 0x7fba541047e0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba59ee9640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5419b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba58ee7640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba44031440 tx=0x7fba44003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4403f070 con 0x7fba541047e0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fba44031b80 con 0x7fba541047e0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5419bbb0 con 0x7fba541047e0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44035030 con 0x7fba541047e0 2024-09-21T06:58:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.891+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba541a2310 con 0x7fba541047e0 2024-09-21T06:58:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.893+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba54103bc0 con 0x7fba541047e0 2024-09-21T06:58:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.894+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fba44042070 con 0x7fba541047e0 2024-09-21T06:58:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.895+0000 7fba4a7fc640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 0x7fba400b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.895+0000 7fba596e8640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 0x7fba400b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.895+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba44105f30 con 0x7fba541047e0 2024-09-21T06:58:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.895+0000 7fba596e8640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 0x7fba400b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba50005fd0 tx=0x7fba50005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:28.900+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba440ce490 con 0x7fba541047e0 2024-09-21T06:58:29.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:29.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:29.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 -- 172.21.15.28:0/3397561198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 msgr2=0x7f53b410b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 --2- 172.21.15.28:0/3397561198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b410b980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009ca0 tx=0x7f53ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 -- 172.21.15.28:0/3397561198 shutdown_connections 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 --2- 172.21.15.28:0/3397561198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b410b980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 --2- 172.21.15.28:0/3397561198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 0x7f53b4108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 --2- 172.21.15.28:0/3397561198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 0x7f53b41063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 -- 172.21.15.28:0/3397561198 >> 172.21.15.28:0/3397561198 conn(0x7f53b40fdfb0 msgr2=0x7f53b4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.071+0000 7f53bc689640 1 -- 172.21.15.28:0/3397561198 shutdown_connections 2024-09-21T06:58:29.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 -- 172.21.15.28:0/3397561198 wait complete. 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 Processor -- start 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 -- start start 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 0x7f53b4199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 0x7f53b419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53b410f240 con 0x7f53b4109470 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f53b410f0c0 con 0x7f53b4106930 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.072+0000 7f53bc689640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53b410f3c0 con 0x7f53b406b920 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41380/0 (socket says 172.21.15.28:41380) 2024-09-21T06:58:29.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 -- 172.21.15.28:0/3441230719 learned_addr learned my addr 172.21.15.28:0/3441230719 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53b9c24640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 0x7f53b419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53ba425640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 0x7f53b4199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 -- 172.21.15.28:0/3441230719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 msgr2=0x7f53b4199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 0x7f53b4199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 -- 172.21.15.28:0/3441230719 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 msgr2=0x7f53b419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 0x7f53b419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 -- 172.21.15.28:0/3441230719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b419b890 con 0x7f53b4109470 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53bac26640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53ac006010 tx=0x7f53ac0307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac030be0 con 0x7f53b4109470 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f53ac031e00 con 0x7f53b4109470 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.073+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0046e0 con 0x7f53b4109470 2024-09-21T06:58:29.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.074+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b419bb20 con 0x7f53b4109470 2024-09-21T06:58:29.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.074+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b41a20b0 con 0x7f53b4109470 2024-09-21T06:58:29.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.075+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b4106d40 con 0x7f53b4109470 2024-09-21T06:58:29.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.076+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f53ac004b40 con 0x7f53b4109470 2024-09-21T06:58:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.077+0000 7f53ab7fe640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 0x7f53a00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.077+0000 7f53ba425640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 0x7f53a00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.077+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f53ac106730 con 0x7f53b4109470 2024-09-21T06:58:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.078+0000 7f53ba425640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 0x7f53a00b8a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009bd0 tx=0x7f53b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.080+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53ac0cec80 con 0x7f53b4109470 2024-09-21T06:58:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.093+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fba54063fc0 con 0x7fba541047e0 2024-09-21T06:58:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.102+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 123+0+0 (secure 0 0 0) 0x7fba440d2870 con 0x7fba541047e0 2024-09-21T06:58:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.102+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ac036070 con 0x7f53b4109470 2024-09-21T06:58:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.102+0000 7fba4a7fc640 1 -- 172.21.15.28:0/603034513 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba44031d30 con 0x7fba541047e0 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 msgr2=0x7fba400b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 0x7fba400b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba50005fd0 tx=0x7fba50005850 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 msgr2=0x7fba5419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba44031440 tx=0x7fba44003c10 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 shutdown_connections 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fba400b6500 0x7fba400b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba54105180 0x7fba5419b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba541047e0 0x7fba5419a5d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 --2- 172.21.15.28:0/603034513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba54103750 0x7fba54199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 >> 172.21.15.28:0/603034513 conn(0x7fba540ff0c0 msgr2=0x7fba54107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 shutdown_connections 2024-09-21T06:58:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.104+0000 7fba5b94c640 1 -- 172.21.15.28:0/603034513 wait complete. 2024-09-21T06:58:29.108 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:29.108 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:29.108 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.282+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f53b402e640 con 0x7f53b4109470 2024-09-21T06:58:29.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.287+0000 7f53ab7fe640 1 -- 172.21.15.28:0/3441230719 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7f53ac0d7f10 con 0x7f53b4109470 2024-09-21T06:58:29.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 msgr2=0x7f53a00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 0x7f53a00b8a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009bd0 tx=0x7f53b0005f90 comp rx=0 tx=0).stop 2024-09-21T06:58:29.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 msgr2=0x7f53b419b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53ac006010 tx=0x7f53ac0307f0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 shutdown_connections 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f53a00b6580 0x7f53a00b8a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53b4109470 0x7f53b419b070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f53b4106930 0x7f53b419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 --2- 172.21.15.28:0/3441230719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53b406b920 0x7f53b4199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 >> 172.21.15.28:0/3441230719 conn(0x7f53b40fdfb0 msgr2=0x7f53b4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 shutdown_connections 2024-09-21T06:58:29.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.289+0000 7f53bc689640 1 -- 172.21.15.28:0/3441230719 wait complete. 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 -- 172.21.15.28:0/1286008531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14481036d0 msgr2=0x7f1448103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 --2- 172.21.15.28:0/1286008531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14481036d0 0x7f1448103ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1438009900 tx=0x7f143802a480 comp rx=0 tx=0).stop 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 -- 172.21.15.28:0/1286008531 shutdown_connections 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 --2- 172.21.15.28:0/1286008531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 0x7f144810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 --2- 172.21.15.28:0/1286008531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14481036d0 0x7f1448103ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 --2- 172.21.15.28:0/1286008531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1448102640 0x7f1448102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.885+0000 7f144fe12640 1 -- 172.21.15.28:0/1286008531 >> 172.21.15.28:0/1286008531 conn(0x7f14480fdfb0 msgr2=0x7f1448100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- 172.21.15.28:0/1286008531 shutdown_connections 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- 172.21.15.28:0/1286008531 wait complete. 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 Processor -- start 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- start start 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14481036d0 0x7f144819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 0x7f144819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f144810e2f0 con 0x7f1448102640 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f144810e170 con 0x7f14481036d0 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144fe12640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f144810e470 con 0x7f1448104070 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.886+0000 7f144dbae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41404/0 (socket says 172.21.15.28:41404) 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 -- 172.21.15.28:0/4033370392 learned_addr learned my addr 172.21.15.28:0/4033370392 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144d3ad640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14481036d0 0x7f144819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144e3af640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 0x7f144819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 -- 172.21.15.28:0/4033370392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 msgr2=0x7f144819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 0x7f144819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 -- 172.21.15.28:0/4033370392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14481036d0 msgr2=0x7f144819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14481036d0 0x7f144819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 -- 172.21.15.28:0/4033370392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144819ba70 con 0x7f1448102640 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144dbae640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f144400c890 tx=0x7f144400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444004220 con 0x7f1448102640 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144819bd60 con 0x7f1448102640 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14440043c0 con 0x7f1448102640 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444004a00 con 0x7f1448102640 2024-09-21T06:58:29.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.887+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14481a2460 con 0x7f1448102640 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.888+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14481a2690 con 0x7f1448102640 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.890+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f14440079b0 con 0x7f1448102640 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.891+0000 7f143effd640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 0x7f14340b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.891+0000 7f144d3ad640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 0x7f14340b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.891+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f14440e54d0 con 0x7f1448102640 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.891+0000 7f144d3ad640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 0x7f14340b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1438031440 tx=0x7f14380314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:29.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:29.895+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1444014030 con 0x7f1448102640 2024-09-21T06:58:30.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:29 smithi028 ceph-mon[31213]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:30.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:29 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/603034513' entity='client.admin' 2024-09-21T06:58:30.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:29 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3441230719' entity='client.admin' 2024-09-21T06:58:30.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.090+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f14481a2860 con 0x7f1448102640 2024-09-21T06:58:30.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.095+0000 7f143effd640 1 -- 172.21.15.28:0/4033370392 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f14440ad990 con 0x7f1448102640 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 msgr2=0x7f14340b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 0x7f14340b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1438031440 tx=0x7f14380314a0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 msgr2=0x7f144819a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f144400c890 tx=0x7f144400cd50 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 shutdown_connections 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f14340b6500 0x7f14340b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1448104070 0x7f144819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14481036d0 0x7f144819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 --2- 172.21.15.28:0/4033370392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1448102640 0x7f144819a040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 >> 172.21.15.28:0/4033370392 conn(0x7f14480fdfb0 msgr2=0x7f14480ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:30.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 shutdown_connections 2024-09-21T06:58:30.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.097+0000 7f144fe12640 1 -- 172.21.15.28:0/4033370392 wait complete. 2024-09-21T06:58:30.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:29 smithi129 ceph-mon[34863]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:30.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:29 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/603034513' entity='client.admin' 2024-09-21T06:58:30.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:29 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3441230719' entity='client.admin' 2024-09-21T06:58:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:29 smithi181 ceph-mon[34686]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:29 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/603034513' entity='client.admin' 2024-09-21T06:58:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:29 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3441230719' entity='client.admin' 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 -- 172.21.15.28:0/595835146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 msgr2=0x7f46c41063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 --2- 172.21.15.28:0/595835146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c41063c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009900 tx=0x7f46b402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 -- 172.21.15.28:0/595835146 shutdown_connections 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 --2- 172.21.15.28:0/595835146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c41094a0 0x7f46c410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 --2- 172.21.15.28:0/595835146 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c4106900 0x7f46c4108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 --2- 172.21.15.28:0/595835146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c41063c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 -- 172.21.15.28:0/595835146 >> 172.21.15.28:0/595835146 conn(0x7f46c40fdfe0 msgr2=0x7f46c4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 -- 172.21.15.28:0/595835146 shutdown_connections 2024-09-21T06:58:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.408+0000 7f46ca55f640 1 -- 172.21.15.28:0/595835146 wait complete. 2024-09-21T06:58:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 Processor -- start 2024-09-21T06:58:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 -- start start 2024-09-21T06:58:30.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c4106900 0x7f46c419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c41094a0 0x7f46c419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410f390 con 0x7f46c406c660 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410f210 con 0x7f46c41094a0 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46ca55f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46c410f510 con 0x7f46c4106900 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41428/0 (socket says 172.21.15.28:41428) 2024-09-21T06:58:30.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46c3fff640 1 -- 172.21.15.28:0/1482682955 learned_addr learned my addr 172.21.15.28:0/1482682955 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46c37fe640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c4106900 0x7f46c419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.409+0000 7f46c8afc640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c41094a0 0x7f46c419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 -- 172.21.15.28:0/1482682955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c4106900 msgr2=0x7f46c419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c4106900 0x7f46c419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 -- 172.21.15.28:0/1482682955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c41094a0 msgr2=0x7f46c419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c41094a0 0x7f46c419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 -- 172.21.15.28:0/1482682955 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c419b9b0 con 0x7f46c406c660 2024-09-21T06:58:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c3fff640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006010 tx=0x7f46b4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b403f030 con 0x7f46c406c660 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b4003cb0 con 0x7f46c406c660 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4035070 con 0x7f46c406c660 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c419bc40 con 0x7f46c406c660 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.410+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c41a2260 con 0x7f46c406c660 2024-09-21T06:58:30.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.411+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c40ffb00 con 0x7f46c406c660 2024-09-21T06:58:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.413+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f46b4042030 con 0x7f46c406c660 2024-09-21T06:58:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.414+0000 7f46c17fa640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 0x7f46ac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.414+0000 7f46c37fe640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 0x7f46ac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.414+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f46b41062a0 con 0x7f46c406c660 2024-09-21T06:58:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.415+0000 7f46c37fe640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 0x7f46ac0b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46b800bbe0 tx=0x7f46b800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:30.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.417+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46b4003e60 con 0x7f46c406c660 2024-09-21T06:58:30.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.606+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f46c402e640 con 0x7f46c406c660 2024-09-21T06:58:30.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.610+0000 7f46c17fa640 1 -- 172.21.15.28:0/1482682955 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7f46b40d2be0 con 0x7f46c406c660 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 msgr2=0x7f46ac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 0x7f46ac0b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46b800bbe0 tx=0x7f46b800b390 comp rx=0 tx=0).stop 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 msgr2=0x7f46c419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006010 tx=0x7f46b4004340 comp rx=0 tx=0).stop 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 shutdown_connections 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f46ac0b6480 0x7f46ac0b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f46c41094a0 0x7f46c419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46c4106900 0x7f46c419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 --2- 172.21.15.28:0/1482682955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f46c406c660 0x7f46c419a010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:30.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 >> 172.21.15.28:0/1482682955 conn(0x7f46c40fdfe0 msgr2=0x7f46c4104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:30.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 shutdown_connections 2024-09-21T06:58:30.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:30.612+0000 7f46ca55f640 1 -- 172.21.15.28:0/1482682955 wait complete. 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4033370392' entity='client.admin' 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1482682955' entity='client.admin' 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:31.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4033370392' entity='client.admin' 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1482682955' entity='client.admin' 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 -- 172.21.15.28:0/3942149086 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 msgr2=0x7fbe50102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/3942149086 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe50102ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009900 tx=0x7fbe4002a480 comp rx=0 tx=0).stop 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 -- 172.21.15.28:0/3942149086 shutdown_connections 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/3942149086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe501040a0 0x7fbe5010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/3942149086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50103700 0x7fbe50103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/3942149086 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe50102ae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 -- 172.21.15.28:0/3942149086 >> 172.21.15.28:0/3942149086 conn(0x7fbe500fdfe0 msgr2=0x7fbe50100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:31.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 -- 172.21.15.28:0/3942149086 shutdown_connections 2024-09-21T06:58:31.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.476+0000 7fbe55bcf640 1 -- 172.21.15.28:0/3942149086 wait complete. 2024-09-21T06:58:31.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 Processor -- start 2024-09-21T06:58:31.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 -- start start 2024-09-21T06:58:31.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 0x7fbe5019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501040a0 0x7fbe5019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5010e310 con 0x7fbe50102670 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5010e190 con 0x7fbe50103700 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.477+0000 7fbe55bcf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5010e490 con 0x7fbe501040a0 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41442/0 (socket says 172.21.15.28:41442) 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 -- 172.21.15.28:0/478981568 learned_addr learned my addr 172.21.15.28:0/478981568 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4effd640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 0x7fbe5019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4ffff640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501040a0 0x7fbe5019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 -- 172.21.15.28:0/478981568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501040a0 msgr2=0x7fbe5019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501040a0 0x7fbe5019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 -- 172.21.15.28:0/478981568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 msgr2=0x7fbe5019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 0x7fbe5019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 -- 172.21.15.28:0/478981568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5019bac0 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4effd640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 0x7fbe5019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4f7fe640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe40006010 tx=0x7fbe40004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.478+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4003f030 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.479+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe40003cb0 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.479+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5019bd50 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.479+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40035070 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.479+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501a2360 con 0x7fbe50102670 2024-09-21T06:58:31.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.480+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe501a2680 con 0x7fbe50102670 2024-09-21T06:58:31.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.482+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fbe40042030 con 0x7fbe50102670 2024-09-21T06:58:31.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.483+0000 7fbe4cff9640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 0x7fbe380b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.483+0000 7fbe4effd640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 0x7fbe380b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.483+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbe40106330 con 0x7fbe50102670 2024-09-21T06:58:31.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.483+0000 7fbe4effd640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 0x7fbe380b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009d60 tx=0x7fbe44009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:31.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.486+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe400ce7f0 con 0x7fbe50102670 2024-09-21T06:58:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4033370392' entity='client.admin' 2024-09-21T06:58:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1482682955' entity='client.admin' 2024-09-21T06:58:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:58:31.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:31.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:58:31.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:58:31.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.678+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fbe501a2850 con 0x7fbe50102670 2024-09-21T06:58:31.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.682+0000 7fbe4cff9640 1 -- 172.21.15.28:0/478981568 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v31)=0 v31) ==== 127+0+0 (secure 0 0 0) 0x7fbe40003e60 con 0x7fbe50102670 2024-09-21T06:58:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 msgr2=0x7fbe380b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 0x7fbe380b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009d60 tx=0x7fbe44009110 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 msgr2=0x7fbe5019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe40006010 tx=0x7fbe40004340 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 shutdown_connections 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe380b6480 0x7fbe380b8990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501040a0 0x7fbe5019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe50103700 0x7fbe5019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 --2- 172.21.15.28:0/478981568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe50102670 0x7fbe5019a090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 >> 172.21.15.28:0/478981568 conn(0x7fbe500fdfe0 msgr2=0x7fbe500ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 shutdown_connections 2024-09-21T06:58:31.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.684+0000 7fbe55bcf640 1 -- 172.21.15.28:0/478981568 wait complete. 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 -- 172.21.15.28:0/2565822917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d81051b0 msgr2=0x7f38d810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 --2- 172.21.15.28:0/2565822917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d81051b0 0x7f38d810bb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009900 tx=0x7f38d002a480 comp rx=0 tx=0).stop 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 -- 172.21.15.28:0/2565822917 shutdown_connections 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 --2- 172.21.15.28:0/2565822917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d81051b0 0x7f38d810bb50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 --2- 172.21.15.28:0/2565822917 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d8104810 0x7f38d8104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 --2- 172.21.15.28:0/2565822917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 0x7f38d8103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 -- 172.21.15.28:0/2565822917 >> 172.21.15.28:0/2565822917 conn(0x7f38d80ff0f0 msgr2=0x7f38d81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:31.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 -- 172.21.15.28:0/2565822917 shutdown_connections 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 -- 172.21.15.28:0/2565822917 wait complete. 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.801+0000 7f38df152640 1 Processor -- start 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 -- start start 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 0x7f38d8199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 0x7f38d819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38d810f420 con 0x7f38d8104810 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f38d810f2a0 con 0x7f38d81051b0 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38df152640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f38d810f5a0 con 0x7f38d8103780 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41460/0 (socket says 172.21.15.28:41460) 2024-09-21T06:58:31.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 -- 172.21.15.28:0/728279944 learned_addr learned my addr 172.21.15.28:0/728279944 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38dceee640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 0x7f38d8199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38dd6ef640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 0x7f38d819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 -- 172.21.15.28:0/728279944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 msgr2=0x7f38d8199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 0x7f38d8199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 -- 172.21.15.28:0/728279944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 msgr2=0x7f38d819b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 0x7f38d819b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 -- 172.21.15.28:0/728279944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d819b9b0 con 0x7f38d8104810 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38dd6ef640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 0x7f38d819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.802+0000 7f38cffff640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38c800d950 tx=0x7f38c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.803+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8017070 con 0x7f38d8104810 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.803+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c8009c30 con 0x7f38d8104810 2024-09-21T06:58:31.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.803+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c800f620 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.803+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d819bca0 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.803+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d81a23a0 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.804+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d810a960 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.806+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f38c8010460 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.807+0000 7f38cdffb640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 0x7f38c00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.807+0000 7f38dceee640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 0x7f38c00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.807+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f38c80e5280 con 0x7f38d8104810 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.808+0000 7f38dceee640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 0x7f38c00b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005fd0 tx=0x7f38d4009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:31.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.810+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38c80ad7c0 con 0x7f38d8104810 2024-09-21T06:58:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:31.998+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f38d802e640 con 0x7f38d8104810 2024-09-21T06:58:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.002+0000 7f38cdffb640 1 -- 172.21.15.28:0/728279944 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v32)=0 v32) ==== 119+0+0 (secure 0 0 0) 0x7f38c8009de0 con 0x7f38d8104810 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 msgr2=0x7f38c00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 0x7f38c00b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005fd0 tx=0x7f38d4009680 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 msgr2=0x7f38d819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38c800d950 tx=0x7f38c800de10 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 shutdown_connections 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38c00b6500 0x7f38c00b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d81051b0 0x7f38d819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38d8104810 0x7f38d819a5f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 --2- 172.21.15.28:0/728279944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38d8103780 0x7f38d8199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 >> 172.21.15.28:0/728279944 conn(0x7f38d80ff0f0 msgr2=0x7f38d8107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 shutdown_connections 2024-09-21T06:58:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:32.004+0000 7f38df152640 1 -- 172.21.15.28:0/728279944 wait complete. 2024-09-21T06:58:32.921 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:32 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/478981568' entity='client.admin' 2024-09-21T06:58:32.922 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:32 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/728279944' entity='client.admin' 2024-09-21T06:58:33.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:32 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/478981568' entity='client.admin' 2024-09-21T06:58:33.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:32 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/728279944' entity='client.admin' 2024-09-21T06:58:33.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:32 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/478981568' entity='client.admin' 2024-09-21T06:58:33.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:32 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/728279944' entity='client.admin' 2024-09-21T06:58:33.189 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi028') 2024-09-21T06:58:33.190 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi028') 2024-09-21T06:58:33.190 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi028') 2024-09-21T06:58:33.190 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi028') 2024-09-21T06:58:33.190 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi028') 2024-09-21T06:58:33.695 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:33 smithi028 ceph-mon[31213]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:34.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:33 smithi181 ceph-mon[34686]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:34.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:33 smithi129 ceph-mon[34863]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:34.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi028') 2024-09-21T06:58:34.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3768746394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b0104080 msgr2=0x7fe4b010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:34.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3768746394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b0104080 0x7fe4b010aa20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009ca0 tx=0x7fe4a802a950 comp rx=0 tx=0).stop 2024-09-21T06:58:34.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3768746394 shutdown_connections 2024-09-21T06:58:34.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3768746394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b0104080 0x7fe4b010aa20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:34.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3768746394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b01036e0 0x7fe4b0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:34.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3768746394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 0x7fe4b0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:34.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3768746394 >> 172.21.15.28:0/3768746394 conn(0x7fe4b00fdfa0 msgr2=0x7fe4b0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:34.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3768746394 shutdown_connections 2024-09-21T06:58:34.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.953+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3768746394 wait complete. 2024-09-21T06:58:34.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 Processor -- start 2024-09-21T06:58:34.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 -- start start 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 0x7fe4b0106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b0104080 0x7fe4b0105030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b010e280 con 0x7fe4b01036e0 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b010e100 con 0x7fe4b0102650 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b7cd4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b010e400 con 0x7fe4b0104080 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b526f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b526f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52962/0 (socket says 172.21.15.28:52962) 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b526f640 1 -- 172.21.15.28:0/3103646004 learned_addr learned my addr 172.21.15.28:0/3103646004 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b5a70640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 0x7fe4b0106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.954+0000 7fe4b6271640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b0104080 0x7fe4b0105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 -- 172.21.15.28:0/3103646004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b0104080 msgr2=0x7fe4b0105030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:34.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b0104080 0x7fe4b0105030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 -- 172.21.15.28:0/3103646004 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 msgr2=0x7fe4b0106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 0x7fe4b0106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 -- 172.21.15.28:0/3103646004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b01056a0 con 0x7fe4b01036e0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b526f640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c920 tx=0x7fe4a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0007c70 con 0x7fe4b01036e0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4a0007e10 con 0x7fe4b01036e0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0018820 con 0x7fe4b01036e0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b01a3fc0 con 0x7fe4b01036e0 2024-09-21T06:58:34.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.955+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b01a4360 con 0x7fe4b01036e0 2024-09-21T06:58:34.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.956+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b0102ac0 con 0x7fe4b01036e0 2024-09-21T06:58:34.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.958+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fe4a000f450 con 0x7fe4b01036e0 2024-09-21T06:58:34.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.959+0000 7fe4a6ffd640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 0x7fe49c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:34.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.959+0000 7fe4b5a70640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 0x7fe49c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:34.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.959+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe4a00e58b0 con 0x7fe4b01036e0 2024-09-21T06:58:34.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.959+0000 7fe4b5a70640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 0x7fe49c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00bbe0 tx=0x7fe4ac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:34.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:34.966+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4a0014030 con 0x7fe4b01036e0 2024-09-21T06:58:35.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.155+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fe4b01a4590 con 0x7fe4b01036e0 2024-09-21T06:58:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.160+0000 7fe4a6ffd640 1 -- 172.21.15.28:0/3103646004 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7fe4b01a4590 con 0x7fe4b01036e0 2024-09-21T06:58:35.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 msgr2=0x7fe49c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:35.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 0x7fe49c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00bbe0 tx=0x7fe4ac00b390 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 msgr2=0x7fe4b0104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c920 tx=0x7fe4a000cde0 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 shutdown_connections 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe49c0b6500 0x7fe49c0b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4b0104080 0x7fe4b0105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4b01036e0 0x7fe4b0104af0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 --2- 172.21.15.28:0/3103646004 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b0102650 0x7fe4b0106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 >> 172.21.15.28:0/3103646004 conn(0x7fe4b00fdfa0 msgr2=0x7fe4b00ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 shutdown_connections 2024-09-21T06:58:35.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:35.162+0000 7fe4b7cd4640 1 -- 172.21.15.28:0/3103646004 wait complete. 2024-09-21T06:58:35.499 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.499 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.499 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.499 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.499 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.500 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.500 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.500 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.500 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi028') 2024-09-21T06:58:35.500 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7b450f7c-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi028') 2024-09-21T06:58:36.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:35 smithi181 ceph-mon[34686]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:36.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3103646004' entity='client.admin' 2024-09-21T06:58:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:35 smithi028 ceph-mon[31213]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:36.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3103646004' entity='client.admin' 2024-09-21T06:58:36.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:35 smithi129 ceph-mon[34863]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:36.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3103646004' entity='client.admin' 2024-09-21T06:58:36.110 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:58:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 -- 172.21.15.28:0/586545505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 msgr2=0x7fa47410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 --2- 172.21.15.28:0/586545505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47410bb20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009ca0 tx=0x7fa46c02a950 comp rx=0 tx=0).stop 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 -- 172.21.15.28:0/586545505 shutdown_connections 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 --2- 172.21.15.28:0/586545505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47410bb20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 --2- 172.21.15.28:0/586545505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4741047e0 0x7fa474104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 --2- 172.21.15.28:0/586545505 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa474103750 0x7fa474103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 -- 172.21.15.28:0/586545505 >> 172.21.15.28:0/586545505 conn(0x7fa4740ff0c0 msgr2=0x7fa474101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 -- 172.21.15.28:0/586545505 shutdown_connections 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.774+0000 7fa478ae1640 1 -- 172.21.15.28:0/586545505 wait complete. 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 Processor -- start 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 -- start start 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa474103750 0x7fa474199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4741047e0 0x7fa47419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410f3a0 con 0x7fa474105180 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410f220 con 0x7fa4741047e0 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.775+0000 7fa478ae1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410f520 con 0x7fa474103750 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52984/0 (socket says 172.21.15.28:52984) 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 -- 172.21.15.28:0/1094243566 learned_addr learned my addr 172.21.15.28:0/1094243566 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:36.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa47259c640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa474103750 0x7fa474199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa471d9b640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4741047e0 0x7fa47419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 -- 172.21.15.28:0/1094243566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa474103750 msgr2=0x7fa474199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa474103750 0x7fa474199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 -- 172.21.15.28:0/1094243566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4741047e0 msgr2=0x7fa47419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4741047e0 0x7fa47419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 -- 172.21.15.28:0/1094243566 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47419b9c0 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa472d9d640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa46c006010 tx=0x7fa46c02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c034040 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa46c0308f0 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47419bc50 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.776+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c039450 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.777+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4741a21e0 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.777+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47410a910 con 0x7fa474105180 2024-09-21T06:58:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.779+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa46c037020 con 0x7fa474105180 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.780+0000 7fa4637fe640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 0x7fa45c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.780+0000 7fa47259c640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 0x7fa45c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.780+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa46c106800 con 0x7fa474105180 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.780+0000 7fa47259c640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 0x7fa45c0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4640058c0 tx=0x7fa46400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.784+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa46c0ced60 con 0x7fa474105180 2024-09-21T06:58:36.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.970+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa47402e640 con 0x7fa474105180 2024-09-21T06:58:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.971+0000 7fa4637fe640 1 -- 172.21.15.28:0/1094243566 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21315 (secure 0 0 0) 0x7fa46c0d3140 con 0x7fa474105180 2024-09-21T06:58:36.972 INFO:teuthology.orchestra.run.smithi028.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global dev auth_debug true 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global basic log_to_file true 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global basic log_to_journald false 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global basic log_to_stderr false 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:58:36.973 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global dev ms_die_on_bug true 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global dev ms_die_on_old_message true 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global dev ms_die_on_skipped_message false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced debug_mon 20/20 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced debug_ms 1/1 2024-09-21T06:58:36.974 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:58:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced debug_client 20/20 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev bdev_debug_aio true 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:58:36.976 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced debug_bluefs 20/20 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced debug_bluestore 20/20 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced debug_ms 1/1 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced debug_osd 20/20 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_op_order true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:58:36.977 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced debug_mds 20/20 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:58:36.978 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced debug_ms 2/2 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds dev mds_debug_frag true 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds dev mds_verify_scatter true 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:client advanced client_mount_timeout 600 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:client advanced debug_client 20/20 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:client advanced debug_ms 1/1 2024-09-21T06:58:36.979 INFO:teuthology.orchestra.run.smithi028.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 msgr2=0x7fa45c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 0x7fa45c0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4640058c0 tx=0x7fa46400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 msgr2=0x7fa47419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa46c006010 tx=0x7fa46c02fc00 comp rx=0 tx=0).stop 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 shutdown_connections 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa45c0b6480 0x7fa45c0b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa474105180 0x7fa47419b1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4741047e0 0x7fa47419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 --2- 172.21.15.28:0/1094243566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa474103750 0x7fa474199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 >> 172.21.15.28:0/1094243566 conn(0x7fa4740ff0c0 msgr2=0x7fa474107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 shutdown_connections 2024-09-21T06:58:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:36.973+0000 7fa478ae1640 1 -- 172.21.15.28:0/1094243566 wait complete. 2024-09-21T06:58:37.680 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:58:37.680 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T06:58:37.680 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:58:37.699 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:58:37.699 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-09-21T06:58:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:58:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:37.756 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:58:37.756 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:37.757 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:37.757 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-21 06:57:27.004029486 +0000 2024-09-21T06:58:37.757 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-21 06:52:52.974869533 +0000 2024-09-21T06:58:37.757 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-21 06:52:52.974869533 +0000 2024-09-21T06:58:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-21 06:52:52.974869533 +0000 2024-09-21T06:58:37.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:58:37.824 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-21T06:58:37.824 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-21T06:58:37.825 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000120219 s, 4.3 MB/s 2024-09-21T06:58:37.826 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:58:37.884 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-09-21T06:58:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:58:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T06:58:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:37.942 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-21 06:57:27.031028773 +0000 2024-09-21T06:58:37.942 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-21 06:52:53.303860858 +0000 2024-09-21T06:58:37.942 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-21 06:52:53.303860858 +0000 2024-09-21T06:58:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-21 06:52:53.303860858 +0000 2024-09-21T06:58:37.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:58:38.004 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:37 smithi028 ceph-mon[31213]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:38.004 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:37 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1094243566' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:58:38.006 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-21T06:58:38.006 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-21T06:58:38.007 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000115179 s, 4.4 MB/s 2024-09-21T06:58:38.008 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:58:38.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:37 smithi181 ceph-mon[34686]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:38.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:37 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1094243566' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:58:38.065 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-09-21T06:58:38.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:37 smithi129 ceph-mon[34863]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:38.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:37 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1094243566' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-21 06:57:27.057028086 +0000 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-21 06:52:53.634852130 +0000 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-21 06:52:53.634852130 +0000 2024-09-21T06:58:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-21 06:52:53.634852130 +0000 2024-09-21T06:58:38.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:58:38.189 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-21T06:58:38.189 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-21T06:58:38.189 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.3171e-05 s, 5.5 MB/s 2024-09-21T06:58:38.190 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:58:38.250 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-21 06:57:27.085027346 +0000 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-21 06:52:53.964843429 +0000 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-21 06:52:53.964843429 +0000 2024-09-21T06:58:38.312 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-21 06:52:53.964843429 +0000 2024-09-21T06:58:38.312 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:58:38.382 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-21T06:58:38.382 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-21T06:58:38.382 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000129859 s, 3.9 MB/s 2024-09-21T06:58:38.383 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:58:38.442 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-21T06:58:38.442 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:58:38.463 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:58:38.464 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 06:58:13.070155291 +0000 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 06:53:12.463260880 +0000 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 06:53:12.463260880 +0000 2024-09-21T06:58:38.524 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 06:53:12.463260880 +0000 2024-09-21T06:58:38.525 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:58:38.594 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T06:58:38.595 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T06:58:38.595 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000263635 s, 1.9 MB/s 2024-09-21T06:58:38.596 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:58:38.655 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-09-21T06:58:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:58:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:38.712 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 06:58:13.070155291 +0000 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 06:53:12.794253647 +0000 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 06:53:12.794253647 +0000 2024-09-21T06:58:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 06:53:12.794253647 +0000 2024-09-21T06:58:38.713 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:58:38.778 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T06:58:38.778 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T06:58:38.778 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000261104 s, 2.0 MB/s 2024-09-21T06:58:38.779 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:58:38.836 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-09-21T06:58:38.892 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:58:38.892 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:38.892 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:58:38.892 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:38.893 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:38.893 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 06:58:13.071155269 +0000 2024-09-21T06:58:38.893 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 06:53:13.114246656 +0000 2024-09-21T06:58:38.893 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 06:53:13.114246656 +0000 2024-09-21T06:58:38.893 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 06:53:13.114246656 +0000 2024-09-21T06:58:38.893 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:58:38.956 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T06:58:38.956 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T06:58:38.956 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000243016 s, 2.1 MB/s 2024-09-21T06:58:38.957 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:58:39.014 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-21 06:58:13.071155269 +0000 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-21 06:53:13.430239752 +0000 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-21 06:53:13.430239752 +0000 2024-09-21T06:58:39.070 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-21 06:53:13.430239752 +0000 2024-09-21T06:58:39.071 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:58:39.133 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-21T06:58:39.133 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-21T06:58:39.134 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000210285 s, 2.4 MB/s 2024-09-21T06:58:39.135 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:58:39.192 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T06:58:39.192 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:58:39.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:58:39.212 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 06:58:10.798658676 +0000 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 06:53:02.160134777 +0000 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 06:53:02.160134777 +0000 2024-09-21T06:58:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 06:53:02.160134777 +0000 2024-09-21T06:58:39.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:58:39.342 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T06:58:39.342 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T06:58:39.342 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000304466 s, 1.7 MB/s 2024-09-21T06:58:39.343 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:58:39.402 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-21T06:58:39.459 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 06:58:10.798658676 +0000 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 06:53:02.477128505 +0000 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 06:53:02.477128505 +0000 2024-09-21T06:58:39.460 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 06:53:02.477128505 +0000 2024-09-21T06:58:39.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:58:39.525 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T06:58:39.525 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T06:58:39.525 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000199788 s, 2.6 MB/s 2024-09-21T06:58:39.526 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:58:39.584 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-21T06:58:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 06:58:10.798658676 +0000 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 06:53:02.831121500 +0000 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 06:53:02.831121500 +0000 2024-09-21T06:58:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 06:53:02.831121500 +0000 2024-09-21T06:58:39.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:58:39.705 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T06:58:39.705 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T06:58:39.705 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000196498 s, 2.6 MB/s 2024-09-21T06:58:39.706 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:58:39.763 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-21T06:58:39.819 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:58:39.819 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:58:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:58:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:58:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:58:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 06:58:10.799658657 +0000 2024-09-21T06:58:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 06:53:03.174114714 +0000 2024-09-21T06:58:39.820 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 06:53:03.174114714 +0000 2024-09-21T06:58:39.820 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 06:53:03.174114714 +0000 2024-09-21T06:58:39.820 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:58:39.883 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T06:58:39.883 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T06:58:39.883 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000199929 s, 2.6 MB/s 2024-09-21T06:58:39.884 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:58:39.941 INFO:tasks.cephadm:Deploying osd.0 on smithi028 with /dev/vg_nvme/lv_4... 2024-09-21T06:58:39.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:58:39.968 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:39 smithi028 ceph-mon[31213]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:40.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:39 smithi181 ceph-mon[34686]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:40.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:39 smithi129 ceph-mon[34863]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:40.204 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:41.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:41 smithi028 ceph-mon[31213]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:42.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:41 smithi181 ceph-mon[34686]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:42.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:41 smithi129 ceph-mon[34863]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:42.529 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:58:42.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi028:vg_nvme/lv_4 2024-09-21T06:58:42.853 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.290+0000 7f76b0ec3640 1 -- 172.21.15.28:0/3249060498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac105180 msgr2=0x7f76ac10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.290+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/3249060498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac105180 0x7f76ac10bb20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009ca0 tx=0x7f76a402a950 comp rx=0 tx=0).stop 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 -- 172.21.15.28:0/3249060498 shutdown_connections 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/3249060498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac105180 0x7f76ac10bb20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/3249060498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac1047e0 0x7f76ac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/3249060498 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac103750 0x7f76ac103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:43.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 -- 172.21.15.28:0/3249060498 >> 172.21.15.28:0/3249060498 conn(0x7f76ac0ff0c0 msgr2=0x7f76ac101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 -- 172.21.15.28:0/3249060498 shutdown_connections 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 -- 172.21.15.28:0/3249060498 wait complete. 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 Processor -- start 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.291+0000 7f76b0ec3640 1 -- start start 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac1047e0 0x7f76ac19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 0x7f76ac19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac10f3a0 con 0x7f76ac103750 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac10f220 con 0x7f76ac1047e0 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76b0ec3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac10f520 con 0x7f76ac105180 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60870/0 (socket says 172.21.15.28:60870) 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 -- 172.21.15.28:0/4241486573 learned_addr learned my addr 172.21.15.28:0/4241486573 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:58:43.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76a9d9b640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac1047e0 0x7f76ac19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aad9d640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 0x7f76ac19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 -- 172.21.15.28:0/4241486573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 msgr2=0x7f76ac19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 0x7f76ac19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 -- 172.21.15.28:0/4241486573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac1047e0 msgr2=0x7f76ac19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac1047e0 0x7f76ac19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 -- 172.21.15.28:0/4241486573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac19b9c0 con 0x7f76ac103750 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aad9d640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 0x7f76ac19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.292+0000 7f76aa59c640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d950 tx=0x7f769c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.293+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c017070 con 0x7f76ac103750 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.293+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f769c009c30 con 0x7f76ac103750 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.293+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ac19bcb0 con 0x7f76ac103750 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.293+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c00f620 con 0x7f76ac103750 2024-09-21T06:58:43.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.293+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ac1a23b0 con 0x7f76ac103750 2024-09-21T06:58:43.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.294+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ac10a910 con 0x7f76ac103750 2024-09-21T06:58:43.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.296+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f769c010460 con 0x7f76ac103750 2024-09-21T06:58:43.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.296+0000 7f769b7fe640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 0x7f76940b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:58:43.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.296+0000 7f76a9d9b640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 0x7f76940b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:58:43.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.297+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f769c0e5260 con 0x7f76ac103750 2024-09-21T06:58:43.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.297+0000 7f76a9d9b640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 0x7f76940b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005fd0 tx=0x7f76a000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:58:43.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.299+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f769c0ad7c0 con 0x7f76ac103750 2024-09-21T06:58:43.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:58:43.497+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f76ac063800 con 0x7f76940b6480 2024-09-21T06:58:44.002 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:43 smithi028 ceph-mon[31213]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:44.002 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:58:44.002 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:58:44.002 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:43 smithi181 ceph-mon[34686]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:58:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:58:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:44.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:43 smithi129 ceph-mon[34863]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:44.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:58:44.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:58:44.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:44.960 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:44 smithi028 ceph-mon[31213]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:45.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:44 smithi181 ceph-mon[34686]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:45.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:44 smithi129 ceph-mon[34863]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:58:45.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:45 smithi028 ceph-mon[31213]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:46.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:45 smithi181 ceph-mon[34686]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:46.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:45 smithi129 ceph-mon[34863]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:47.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:46 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"} : dispatch 2024-09-21T06:58:47.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:46 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"}]': finished 2024-09-21T06:58:47.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:46 smithi181 ceph-mon[34686]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:58:47.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:46 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:58:47.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:46 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2396853827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:58:47.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:46 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"} : dispatch 2024-09-21T06:58:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:46 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"}]': finished 2024-09-21T06:58:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:46 smithi028 ceph-mon[31213]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:58:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:46 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:58:47.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:46 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2396853827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:58:47.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:46 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"} : dispatch 2024-09-21T06:58:47.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:46 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2465844797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f58e89f6-8401-4336-a335-96041060dc38"}]': finished 2024-09-21T06:58:47.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:46 smithi129 ceph-mon[34863]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:58:47.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:46 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:58:47.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:46 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2396853827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:58:48.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:47 smithi129 ceph-mon[34863]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:48.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:47 smithi181 ceph-mon[34686]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:48.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:47 smithi028 ceph-mon[31213]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:50.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:49 smithi129 ceph-mon[34863]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:50.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:49 smithi181 ceph-mon[34686]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:50.277 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:49 smithi028 ceph-mon[31213]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:52.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:51 smithi129 ceph-mon[34863]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:52.254 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:51 smithi028 ceph-mon[31213]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:52.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:51 smithi181 ceph-mon[34686]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:53 smithi028 ceph-mon[31213]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:53 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:58:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:53 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:54.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:53 smithi129 ceph-mon[34863]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:54.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:53 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:58:54.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:53 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:54.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:53 smithi181 ceph-mon[34686]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:54.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:53 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:58:54.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:53 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:58:54.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:54 smithi028 ceph-mon[31213]: Deploying daemon osd.0 on smithi028 2024-09-21T06:58:55.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:54 smithi129 ceph-mon[34863]: Deploying daemon osd.0 on smithi028 2024-09-21T06:58:55.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:54 smithi181 ceph-mon[34686]: Deploying daemon osd.0 on smithi028 2024-09-21T06:58:56.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:55 smithi028 ceph-mon[31213]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:56.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:55 smithi129 ceph-mon[34863]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:55 smithi181 ceph-mon[34686]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:58.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:57 smithi129 ceph-mon[34863]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:58.202 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:57 smithi028 ceph-mon[31213]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:58:58.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:57 smithi181 ceph-mon[34686]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:00.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:59 smithi129 ceph-mon[34863]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:58:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:00.138 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:59 smithi028 ceph-mon[31213]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:00.138 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:00.138 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:00.139 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:58:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:59 smithi181 ceph-mon[34686]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:00.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:58:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:02.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:01 smithi028 ceph-mon[31213]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:02.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:01 smithi181 ceph-mon[34686]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:02.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:01 smithi129 ceph-mon[34863]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:03.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:03.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:03.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:03.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:03 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:03 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:03.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:03.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:03.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:03 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:03.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.608+0000 7f769b7fe640 1 -- 172.21.15.28:0/4241486573 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76ac063800 con 0x7f76940b6480 2024-09-21T06:59:03.611 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 0 on host 'smithi028' 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 msgr2=0x7f76940b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 0x7f76940b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005fd0 tx=0x7f76a000b390 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 msgr2=0x7f76ac199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f769c00d950 tx=0x7f769c00de10 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 shutdown_connections 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f76940b6480 0x7f76940b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76ac105180 0x7f76ac19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76ac1047e0 0x7f76ac19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 --2- 172.21.15.28:0/4241486573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76ac103750 0x7f76ac199f90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 >> 172.21.15.28:0/4241486573 conn(0x7f76ac0ff0c0 msgr2=0x7f76ac107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 shutdown_connections 2024-09-21T06:59:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:03.610+0000 7f76b0ec3640 1 -- 172.21.15.28:0/4241486573 wait complete. 2024-09-21T06:59:04.185 DEBUG:teuthology.orchestra.run.smithi028:osd.0> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:59:04.187 INFO:tasks.cephadm:Deploying osd.1 on smithi129 with /dev/vg_nvme/lv_4... 2024-09-21T06:59:04.187 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:59:04.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:04.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:04.430 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:04.438 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:59:04.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:04.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:04.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:04.560 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:04.560 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:04.560 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:05.548 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T06:59:05.487+0000 7ff169ecf640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:59:05.615 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:05 smithi129 ceph-mon[34863]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:05.616 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:05 smithi129 ceph-mon[34863]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:59:06.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:05 smithi181 ceph-mon[34686]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:06.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:05 smithi181 ceph-mon[34686]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:59:06.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:05 smithi028 ceph-mon[31213]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:06.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:05 smithi028 ceph-mon[31213]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:59:06.622 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T06:59:06.650 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_4 2024-09-21T06:59:06.896 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:59:06.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:06 smithi028 ceph-mon[31213]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:59:06.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:06 smithi028 ceph-mon[31213]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:59:06.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:06 smithi028 ceph-mon[31213]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T06:59:06.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:06 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:06.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:06 smithi028 ceph-mon[31213]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T06:59:07.017 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:06 smithi129 ceph-mon[34863]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:59:07.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:06 smithi129 ceph-mon[34863]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:59:07.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:06 smithi129 ceph-mon[34863]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T06:59:07.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:06 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:07.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:06 smithi129 ceph-mon[34863]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T06:59:07.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:06 smithi181 ceph-mon[34686]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:59:07.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:06 smithi181 ceph-mon[34686]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:59:07.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:06 smithi181 ceph-mon[34686]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T06:59:07.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:06 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:07.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:06 smithi181 ceph-mon[34686]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T06:59:07.298 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T06:59:07.056+0000 7ff165e51640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:59:07.298 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T06:59:07.060+0000 7ff15dc47640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:59:07.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 -- 172.21.15.129:0/3474380369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038109500 msgr2=0x7f103810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:07.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 --2- 172.21.15.129:0/3474380369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038109500 0x7f103810b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1030009ca0 tx=0x7f103002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 -- 172.21.15.129:0/3474380369 shutdown_connections 2024-09-21T06:59:07.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 --2- 172.21.15.129:0/3474380369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038109500 0x7f103810b980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 --2- 172.21.15.129:0/3474380369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f1038108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 --2- 172.21.15.129:0/3474380369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038101b00 0x7f1038101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 -- 172.21.15.129:0/3474380369 >> 172.21.15.129:0/3474380369 conn(0x7f10380fd770 msgr2=0x7f10380ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:07.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 -- 172.21.15.129:0/3474380369 shutdown_connections 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.365+0000 7f1040552640 1 -- 172.21.15.129:0/3474380369 wait complete. 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 Processor -- start 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 -- start start 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f103819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038109500 0x7f103819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f103810f380 con 0x7f1038106ba0 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f103810f200 con 0x7f1038101b00 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f1040552640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f103810f500 con 0x7f1038109500 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f103e2ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:07.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f103e2ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:59020/0 (socket says 172.21.15.129:59020) 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.366+0000 7f103e2ee640 1 -- 172.21.15.129:0/1888770855 learned_addr learned my addr 172.21.15.129:0/1888770855 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103eaef640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038109500 0x7f103819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103daed640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f103819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 -- 172.21.15.129:0/1888770855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038109500 msgr2=0x7f103819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038109500 0x7f103819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 -- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 msgr2=0x7f103819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f103819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 -- 172.21.15.129:0/1888770855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103819b970 con 0x7f1038101b00 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103daed640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f103819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f103e2ee640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f103400e9f0 tx=0x7f103400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103400cd80 con 0x7f1038101b00 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103819bc60 con 0x7f1038101b00 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10340054d0 con 0x7f1038101b00 2024-09-21T06:59:07.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034010690 con 0x7f1038101b00 2024-09-21T06:59:07.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.367+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a2360 con 0x7f1038101b00 2024-09-21T06:59:07.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.368+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10380ff290 con 0x7f1038101b00 2024-09-21T06:59:07.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.370+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1034004e50 con 0x7f1038101b00 2024-09-21T06:59:07.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.370+0000 7f102f7fe640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 0x7f10240b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:07.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.371+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f10340e5db0 con 0x7f1038101b00 2024-09-21T06:59:07.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.371+0000 7f103daed640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 0x7f10240b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:07.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.371+0000 7f103daed640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 0x7f10240b8990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1028009b50 tx=0x7f1028005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:07.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.374+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1034056710 con 0x7f1038101b00 2024-09-21T06:59:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:07.561+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1038063800 con 0x7f10240b6480 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:07.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:07.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:08.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:08.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256]' entity='osd.0' 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:08.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:08.928 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi028 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi028 to 17092M 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] boot 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:59:09.363 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi028 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi028 to 17092M 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] boot 2024-09-21T06:59:09.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi028 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi028 to 17092M 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: osd.0 [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] boot 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:59:09.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:59:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:09 smithi129 ceph-mon[34863]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:09.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:09 smithi129 ceph-mon[34863]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:59:10.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:09 smithi181 ceph-mon[34686]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:10.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:09 smithi181 ceph-mon[34686]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:59:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:09 smithi028 ceph-mon[31213]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:10.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:09 smithi028 ceph-mon[31213]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:59:10.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/155047790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"}]': finished 2024-09-21T06:59:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:59:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:10 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/386431423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:11.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/155047790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:11.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:11.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"}]': finished 2024-09-21T06:59:11.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:59:11.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:11.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:10 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/386431423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/155047790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"} : dispatch 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bac69547-8286-49a6-8ed8-bac8cf91e592"}]': finished 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:11.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:10 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/386431423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:11 smithi181 ceph-mon[34686]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:12.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:11 smithi028 ceph-mon[31213]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:12.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:11 smithi129 ceph-mon[34863]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:14.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:13 smithi181 ceph-mon[34686]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:14.289 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:13 smithi129 ceph-mon[34863]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:14.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:13 smithi028 ceph-mon[31213]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:16.258 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:15 smithi129 ceph-mon[34863]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:15 smithi181 ceph-mon[34686]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:16.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:15 smithi028 ceph-mon[31213]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:18.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:17 smithi129 ceph-mon[34863]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:18.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:59:18.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:17 smithi181 ceph-mon[34686]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:59:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:17 smithi028 ceph-mon[31213]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:59:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:19.239 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:18 smithi129 ceph-mon[34863]: Deploying daemon osd.1 on smithi129 2024-09-21T06:59:19.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:18 smithi181 ceph-mon[34686]: Deploying daemon osd.1 on smithi129 2024-09-21T06:59:19.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:18 smithi028 ceph-mon[31213]: Deploying daemon osd.1 on smithi129 2024-09-21T06:59:20.242 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:19 smithi129 ceph-mon[34863]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:20.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:19 smithi181 ceph-mon[34686]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:20.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:19 smithi028 ceph-mon[31213]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:22.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:21 smithi181 ceph-mon[34686]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:21 smithi028 ceph-mon[31213]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:22.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:21 smithi129 ceph-mon[34863]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:24.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:23 smithi181 ceph-mon[34686]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:23 smithi028 ceph-mon[31213]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:24.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:23 smithi129 ceph-mon[34863]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:25.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:25.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:25.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:25.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:25.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:25.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:25.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:26.258 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:25 smithi129 ceph-mon[34863]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:26.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:25 smithi181 ceph-mon[34686]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:25 smithi028 ceph-mon[31213]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:27.579 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:27.579 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.579 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.580 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:27.580 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:27.580 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:27.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.180+0000 7f102f7fe640 1 -- 172.21.15.129:0/1888770855 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1038063800 con 0x7f10240b6480 2024-09-21T06:59:28.183 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 1 on host 'smithi129' 2024-09-21T06:59:28.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 msgr2=0x7f10240b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 0x7f10240b8990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1028009b50 tx=0x7f1028005f90 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 msgr2=0x7f1038199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f103400e9f0 tx=0x7f103400edf0 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 shutdown_connections 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f10240b6480 0x7f10240b8990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1038109500 0x7f103819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1038106ba0 0x7f103819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 --2- 172.21.15.129:0/1888770855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1038101b00 0x7f1038199f40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 >> 172.21.15.129:0/1888770855 conn(0x7f10380fd770 msgr2=0x7f1038107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 shutdown_connections 2024-09-21T06:59:28.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T06:59:28.183+0000 7f1040552640 1 -- 172.21.15.129:0/1888770855 wait complete. 2024-09-21T06:59:28.491 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:28.491 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.491 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:28.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.785 DEBUG:teuthology.orchestra.run.smithi129:osd.1> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:59:28.788 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-09-21T06:59:28.788 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:59:28.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:28.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:28.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:29.043 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:59:29.429 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:29 smithi181 ceph-mon[34686]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:29.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:29 smithi129 ceph-mon[34863]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:29 smithi028 ceph-mon[31213]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:30.607 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 06:59:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T06:59:30.355+0000 7f4ec9bf5640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:59:31.341 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T06:59:31.366 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-09-21T06:59:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:31 smithi181 ceph-mon[34686]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:31 smithi181 ceph-mon[34686]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:31.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:31 smithi181 ceph-mon[34686]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:31.596 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:31 smithi129 ceph-mon[34863]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:31.596 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:31 smithi129 ceph-mon[34863]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:31.596 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:31 smithi129 ceph-mon[34863]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:31.609 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:59:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:31 smithi028 ceph-mon[31213]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:31 smithi028 ceph-mon[31213]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:31 smithi028 ceph-mon[31213]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 -- 172.21.15.181:0/3446418843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0105180 msgr2=0x7f5be010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 --2- 172.21.15.181:0/3446418843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0105180 0x7f5be010bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009ca0 tx=0x7f5bd802a950 comp rx=0 tx=0).stop 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 -- 172.21.15.181:0/3446418843 shutdown_connections 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 --2- 172.21.15.181:0/3446418843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0105180 0x7f5be010bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 --2- 172.21.15.181:0/3446418843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 --2- 172.21.15.181:0/3446418843 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0103750 0x7f5be0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 -- 172.21.15.181:0/3446418843 >> 172.21.15.181:0/3446418843 conn(0x7f5be00ff0e0 msgr2=0x7f5be0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 -- 172.21.15.181:0/3446418843 shutdown_connections 2024-09-21T06:59:32.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.069+0000 7f5be54ba640 1 -- 172.21.15.181:0/3446418843 wait complete. 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 Processor -- start 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 -- start start 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 0x7f5be019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5be010f380 con 0x7f5be01047e0 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5be010f200 con 0x7f5be0105180 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5be54ba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5be010f500 con 0x7f5be0103750 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:32.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34720/0 (socket says 172.21.15.181:34720) 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdeffd640 1 -- 172.21.15.181:0/2564876050 learned_addr learned my addr 172.21.15.181:0/2564876050 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bde7fc640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdf7fe640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 0x7f5be019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdeffd640 1 -- 172.21.15.181:0/2564876050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 msgr2=0x7f5be019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.070+0000 7f5bdeffd640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 0x7f5be019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bdeffd640 1 -- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 msgr2=0x7f5be019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bdeffd640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bdeffd640 1 -- 172.21.15.181:0/2564876050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be019b920 con 0x7f5be0103750 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bde7fc640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bdf7fe640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 0x7f5be019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bdeffd640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c920 tx=0x7f5bd000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:32.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0007c70 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be019bc10 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd0007e10 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0018820 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.071+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01a23a0 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.072+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be010a930 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.074+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5bd000f450 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.075+0000 7f5bc7fff640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 0x7f5bc80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.075+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f5bd00e5d80 con 0x7f5be0103750 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.075+0000 7f5bde7fc640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 0x7f5bc80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.076+0000 7f5bde7fc640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 0x7f5bc80b8990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40058c0 tx=0x7f5bd4005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.078+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bd0014030 con 0x7f5be0103750 2024-09-21T06:59:32.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:32.263+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5be0063800 con 0x7f5bc80b6480 2024-09-21T06:59:32.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:59:32.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:59:32.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi129 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi129 to 17088M 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:32.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi129 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi129 to 17088M 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:32.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:32.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:32.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:32.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T06:59:32.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi129 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi129 to 17088M 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:32.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:33.106 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T06:59:32.735+0000 7f4ec638c640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:59:33.107 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 06:59:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T06:59:32.741+0000 7f4ebd96d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:59:33.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:33 smithi129 ceph-mon[34863]: from='osd.1 ' entity='osd.1' 2024-09-21T06:59:33.639 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:33 smithi181 ceph-mon[34686]: from='osd.1 ' entity='osd.1' 2024-09-21T06:59:33.699 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:33.699 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:33.699 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T06:59:33.699 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:59:33.699 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.700 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:33.700 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:33 smithi028 ceph-mon[31213]: from='osd.1 ' entity='osd.1' 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] boot 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:59:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:34.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T06:59:34.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T06:59:34.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:34.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] boot 2024-09-21T06:59:34.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:59:34.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: osd.1 [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] boot 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:59:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:59:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/922847290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"}]': finished 2024-09-21T06:59:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T06:59:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/2076589115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:35.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/922847290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"}]': finished 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:35.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/2076589115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/922847290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"} : dispatch 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6691236c-3f1e-4af1-bb2d-e8f46ac32640"}]': finished 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/2076589115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:59:37.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:37 smithi129 ceph-mon[34863]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:37.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:37 smithi181 ceph-mon[34686]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:37 smithi028 ceph-mon[31213]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:39.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:39 smithi129 ceph-mon[34863]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:39.760 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:39 smithi181 ceph-mon[34686]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:39.846 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:39 smithi028 ceph-mon[31213]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:41.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:41 smithi129 ceph-mon[34863]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:41.607 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:41 smithi181 ceph-mon[34686]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:41.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:41 smithi028 ceph-mon[31213]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:43.431 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:43 smithi181 ceph-mon[34686]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:43.431 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:59:43.431 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:43.431 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:43 smithi181 ceph-mon[34686]: Deploying daemon osd.2 on smithi181 2024-09-21T06:59:43.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:43 smithi028 ceph-mon[31213]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:43.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:59:43.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:43.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:43 smithi028 ceph-mon[31213]: Deploying daemon osd.2 on smithi181 2024-09-21T06:59:43.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:43 smithi129 ceph-mon[34863]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:43.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:59:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:43 smithi129 ceph-mon[34863]: Deploying daemon osd.2 on smithi181 2024-09-21T06:59:45.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:45 smithi181 ceph-mon[34686]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:45.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:45 smithi028 ceph-mon[31213]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:45 smithi129 ceph-mon[34863]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:47.652 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:47 smithi181 ceph-mon[34686]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:47 smithi028 ceph-mon[31213]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:47 smithi129 ceph-mon[34863]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:49.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:49 smithi181 ceph-mon[34686]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:49.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:49.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:49.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:49 smithi028 ceph-mon[31213]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:49 smithi129 ceph-mon[34863]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:51 smithi181 ceph-mon[34686]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:51 smithi028 ceph-mon[31213]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:51 smithi129 ceph-mon[34863]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:52.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:52.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.107+0000 7f5bc7fff640 1 -- 172.21.15.181:0/2564876050 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5be0063800 con 0x7f5bc80b6480 2024-09-21T06:59:53.109 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-09-21T06:59:53.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 msgr2=0x7f5bc80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:53.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 0x7f5bc80b8990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40058c0 tx=0x7f5bd4005ec0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 msgr2=0x7f5be0199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c920 tx=0x7f5bd000cde0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 shutdown_connections 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5bc80b6480 0x7f5bc80b8990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5be0105180 0x7f5be019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5be01047e0 0x7f5be019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 --2- 172.21.15.181:0/2564876050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5be0103750 0x7f5be0199f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 >> 172.21.15.181:0/2564876050 conn(0x7f5be00ff0e0 msgr2=0x7f5be0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 shutdown_connections 2024-09-21T06:59:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T06:59:53.110+0000 7f5be54ba640 1 -- 172.21.15.181:0/2564876050 wait complete. 2024-09-21T06:59:53.379 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:53 smithi181 ceph-mon[34686]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:53.379 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:53 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:53.379 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:53 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.379 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:53 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:53 smithi028 ceph-mon[31213]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:53.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:53 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:53.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:53 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:53 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.832 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:59:53.835 INFO:tasks.cephadm:Deploying osd.3 on smithi028 with /dev/vg_nvme/lv_3... 2024-09-21T06:59:53.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:59:53.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:53 smithi129 ceph-mon[34863]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:53.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:53 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:53.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:53 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:53.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:53 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:54.101 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:59:54.926 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 06:59:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T06:59:54.651+0000 7f90c9708640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:59:55.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:55 smithi028 ceph-mon[31213]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:55.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:55 smithi028 ceph-mon[31213]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:55.431 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:55 smithi028 ceph-mon[31213]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:55.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:55 smithi181 ceph-mon[34686]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:55.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:55 smithi181 ceph-mon[34686]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:55.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:55 smithi181 ceph-mon[34686]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:55.659 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:55 smithi129 ceph-mon[34863]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:55.659 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:55 smithi129 ceph-mon[34863]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:55.659 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:55 smithi129 ceph-mon[34863]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:59:56.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-mon[34686]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:59:56.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-mon[34686]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:59:56.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:56.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-mon[34686]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:56.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-mon[34686]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:56.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:56 smithi028 ceph-mon[31213]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:59:56.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:56 smithi028 ceph-mon[31213]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:59:56.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:56.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:56 smithi028 ceph-mon[31213]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:56.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:56 smithi028 ceph-mon[31213]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:56.551 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T06:59:56.581 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi028:vg_nvme/lv_3 2024-09-21T06:59:56.844 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:59:56.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:56 smithi129 ceph-mon[34863]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:59:56.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:56 smithi129 ceph-mon[34863]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:59:56.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:56.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:56 smithi129 ceph-mon[34863]: from='osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:56.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:56 smithi129 ceph-mon[34863]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T06:59:57.019 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T06:59:56.830+0000 7f90c5e9f640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:59:57.019 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 06:59:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T06:59:56.836+0000 7f90bd480640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 -- 172.21.15.28:0/3382416429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0102670 msgr2=0x7f26f0102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 --2- 172.21.15.28:0/3382416429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0102670 0x7f26f0102ae0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009900 tx=0x7f26e002a480 comp rx=0 tx=0).stop 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 -- 172.21.15.28:0/3382416429 shutdown_connections 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 --2- 172.21.15.28:0/3382416429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f01040a0 0x7f26f010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 --2- 172.21.15.28:0/3382416429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f0103700 0x7f26f0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 --2- 172.21.15.28:0/3382416429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0102670 0x7f26f0102ae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 -- 172.21.15.28:0/3382416429 >> 172.21.15.28:0/3382416429 conn(0x7f26f00fdfe0 msgr2=0x7f26f0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.296+0000 7f26f549d640 1 -- 172.21.15.28:0/3382416429 shutdown_connections 2024-09-21T06:59:57.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 -- 172.21.15.28:0/3382416429 wait complete. 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 Processor -- start 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 -- start start 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 0x7f26f0199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f01040a0 0x7f26f019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010f3e0 con 0x7f26f0103700 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010f260 con 0x7f26f01040a0 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.297+0000 7f26f549d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010f560 con 0x7f26f0102670 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39950/0 (socket says 172.21.15.28:39950) 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 -- 172.21.15.28:0/688612507 learned_addr learned my addr 172.21.15.28:0/688612507 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26ef7fe640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f01040a0 0x7f26f019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26eeffd640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 0x7f26f0199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 -- 172.21.15.28:0/688612507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 msgr2=0x7f26f0199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 0x7f26f0199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 -- 172.21.15.28:0/688612507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f01040a0 msgr2=0x7f26f019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f01040a0 0x7f26f019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 -- 172.21.15.28:0/688612507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f019ba20 con 0x7f26f0103700 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26eeffd640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 0x7f26f0199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26e7fff640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26d800d950 tx=0x7f26d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8017070 con 0x7f26f0103700 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d8009c30 con 0x7f26f0103700 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f019bd10 con 0x7f26f0103700 2024-09-21T06:59:57.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d800f620 con 0x7f26f0103700 2024-09-21T06:59:57.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.298+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f01a2410 con 0x7f26f0103700 2024-09-21T06:59:57.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.299+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0109850 con 0x7f26f0103700 2024-09-21T06:59:57.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.301+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f26d8010460 con 0x7f26f0103700 2024-09-21T06:59:57.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.302+0000 7f26ecff9640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 0x7f26dc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.302+0000 7f26eeffd640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 0x7f26dc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.302+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f26d80e57e0 con 0x7f26f0103700 2024-09-21T06:59:57.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.303+0000 7f26eeffd640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 0x7f26dc0b8990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005f70 tx=0x7f26e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.305+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26d80ad7c0 con 0x7f26f0103700 2024-09-21T06:59:57.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T06:59:57.506+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f26f0063800 con 0x7f26dc0b6480 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi181 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T06:59:57.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:57.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:57.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:57 smithi028 ceph-mon[31213]: from='osd.2 ' entity='osd.2' 2024-09-21T06:59:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi181 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:57.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:57 smithi181 ceph-mon[34686]: from='osd.2 ' entity='osd.2' 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi181 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:59:57.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T06:59:57.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:57.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:59:57.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T06:59:57.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:57 smithi129 ceph-mon[34863]: from='osd.2 ' entity='osd.2' 2024-09-21T06:59:58.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T06:59:58.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T06:59:58.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:58.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:58.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:58.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:58.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:58.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] boot 2024-09-21T06:59:58.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T06:59:58.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:58.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:58.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:58.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] boot 2024-09-21T06:59:58.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T06:59:58.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: osd.2 [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] boot 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T06:59:58.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:59:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:59 smithi181 ceph-mon[34686]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 06:59:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:59:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:59 smithi028 ceph-mon[31213]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 06:59:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:59:59.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:59 smithi129 ceph-mon[34863]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:59:59.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 06:59:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50936]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50936]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50952]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50952]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 sudo[50952]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50923]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.299 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 06:59:59 smithi028 sudo[50926]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42621]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42621]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42621]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42624]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42624]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42624]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42615]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42615]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42615]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42618]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42618]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.358 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.358 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:00:00 smithi129 sudo[42618]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.405 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42465]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42465]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42465]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42468]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.406 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:00:00.406 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.406 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.407 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42459]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.407 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:00:00.407 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:00:00.407 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:00:00.407 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:00:00 smithi181 sudo[42462]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:00:00.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"} : dispatch 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"}]': finished 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: overall HEALTH_OK 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:00 smithi181 ceph-mon[34686]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:00:00.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"} : dispatch 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"}]': finished 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: overall HEALTH_OK 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:00 smithi028 ceph-mon[31213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"} : dispatch 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2767123775' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b22145b-f0e6-4fa1-ae2c-91614505ef38"}]': finished 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:00.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: overall HEALTH_OK 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:00.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:00:00.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:00.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:00.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:00.859 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:00 smithi129 ceph-mon[34863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:00:01.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:01.158+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f26d80a9330 con 0x7f26f0103700 2024-09-21T07:00:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:01 smithi028 ceph-mon[31213]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:01 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4186071645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:01 smithi028 ceph-mon[31213]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:00:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:01 smithi028 ceph-mon[31213]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:00:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:01 smithi181 ceph-mon[34686]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:01 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4186071645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:01 smithi181 ceph-mon[34686]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:00:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:01 smithi181 ceph-mon[34686]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:00:01.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:01 smithi129 ceph-mon[34863]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:01 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4186071645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:01 smithi129 ceph-mon[34863]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:00:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:01 smithi129 ceph-mon[34863]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:00:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:03 smithi181 ceph-mon[34686]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:03.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:03 smithi028 ceph-mon[31213]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:03.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:03 smithi129 ceph-mon[34863]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:05 smithi181 ceph-mon[34686]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:05 smithi028 ceph-mon[31213]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:05.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:05 smithi129 ceph-mon[34863]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:07.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:07 smithi028 ceph-mon[31213]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:07 smithi181 ceph-mon[34686]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:07 smithi129 ceph-mon[34863]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:08.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:00:08.685 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:08.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:00:08.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:08.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:00:08.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:09.521 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:09 smithi028 ceph-mon[31213]: Deploying daemon osd.3 on smithi028 2024-09-21T07:00:09.521 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:09 smithi028 ceph-mon[31213]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:09 smithi181 ceph-mon[34686]: Deploying daemon osd.3 on smithi028 2024-09-21T07:00:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:09 smithi181 ceph-mon[34686]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:09 smithi129 ceph-mon[34863]: Deploying daemon osd.3 on smithi028 2024-09-21T07:00:09.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:09 smithi129 ceph-mon[34863]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:11.694 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:11 smithi028 ceph-mon[31213]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:11.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:11 smithi181 ceph-mon[34686]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:11.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:11 smithi129 ceph-mon[34863]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:13.693 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:13 smithi028 ceph-mon[31213]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:13.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:13 smithi181 ceph-mon[34686]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:13.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:13 smithi129 ceph-mon[34863]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:15 smithi181 ceph-mon[34686]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:15 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:15.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:15 smithi028 ceph-mon[31213]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:15.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:15.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:15.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:15 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:15.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:15 smithi129 ceph-mon[34863]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:15.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:15.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:15.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:15 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:17.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:17.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:17.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.254+0000 7f26ecff9640 1 -- 172.21.15.28:0/688612507 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26f0063800 con 0x7f26dc0b6480 2024-09-21T07:00:18.257 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 3 on host 'smithi028' 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.256+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 msgr2=0x7f26dc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.256+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 0x7f26dc0b8990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005f70 tx=0x7f26e0000bc0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.256+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 msgr2=0x7f26f019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.256+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26d800d950 tx=0x7f26d800de10 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 shutdown_connections 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f26dc0b6480 0x7f26dc0b8990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f01040a0 0x7f26f019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26f0103700 0x7f26f019a660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 --2- 172.21.15.28:0/688612507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26f0102670 0x7f26f0199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 >> 172.21.15.28:0/688612507 conn(0x7f26f00fdfe0 msgr2=0x7f26f0106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:18.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 shutdown_connections 2024-09-21T07:00:18.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:00:18.257+0000 7f26f549d640 1 -- 172.21.15.28:0/688612507 wait complete. 2024-09-21T07:00:18.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:18 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:18.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:18 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:18 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:18 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:18.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:18 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:18 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:18 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:18.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:18 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:18 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:18.873 DEBUG:teuthology.orchestra.run.smithi028:osd.3> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T07:00:18.875 INFO:tasks.cephadm:Deploying osd.4 on smithi129 with /dev/vg_nvme/lv_3... 2024-09-21T07:00:18.875 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:00:19.128 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:00:19.486 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:19 smithi129 ceph-mon[34863]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:19.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:19 smithi028 ceph-mon[31213]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:19.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:19 smithi181 ceph-mon[34686]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:20.798 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:00:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:00:20.459+0000 7fa2a4041640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:00:21.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:21 smithi129 ceph-mon[34863]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:21.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:21 smithi129 ceph-mon[34863]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:00:21.622 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:21 smithi028 ceph-mon[31213]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:21.622 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:21 smithi028 ceph-mon[31213]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:00:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:00:21.695 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_3 2024-09-21T07:00:21.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:21 smithi181 ceph-mon[34686]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:21.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:21 smithi181 ceph-mon[34686]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:00:21.945 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:00:22.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.451+0000 7fd8e0051640 1 -- 172.21.15.129:0/114603384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 msgr2=0x7fd8d8102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.451+0000 7fd8e0051640 1 --2- 172.21.15.129:0/114603384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d8102230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009900 tx=0x7fd8d402a480 comp rx=0 tx=0).stop 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 -- 172.21.15.129:0/114603384 shutdown_connections 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 --2- 172.21.15.129:0/114603384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 0x7fd8d810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 --2- 172.21.15.129:0/114603384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d8103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 --2- 172.21.15.129:0/114603384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d8102230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 -- 172.21.15.129:0/114603384 >> 172.21.15.129:0/114603384 conn(0x7fd8d80fd770 msgr2=0x7fd8d80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 -- 172.21.15.129:0/114603384 shutdown_connections 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 -- 172.21.15.129:0/114603384 wait complete. 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 Processor -- start 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.452+0000 7fd8e0051640 1 -- start start 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 0x7fd8d81a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d810da00 con 0x7fd8d81037f0 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d810d880 con 0x7fd8d8101dc0 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8e0051640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d810db80 con 0x7fd8d8102e50 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:33002/0 (socket says 172.21.15.129:33002) 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 -- 172.21.15.129:0/4217858944 learned_addr learned my addr 172.21.15.129:0/4217858944 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8dd5ec640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8de5ee640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 0x7fd8d81a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 -- 172.21.15.129:0/4217858944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 msgr2=0x7fd8d819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 -- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 msgr2=0x7fd8d81a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 0x7fd8d81a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 -- 172.21.15.129:0/4217858944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d81a1a40 con 0x7fd8d8101dc0 2024-09-21T07:00:22.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8dd5ec640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:22.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.453+0000 7fd8ddded640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.457+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d403f030 con 0x7fd8d8101dc0 2024-09-21T07:00:22.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.457+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d4003aa0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.457+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d81a1cd0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.457+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4035070 con 0x7fd8d8101dc0 2024-09-21T07:00:22.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.457+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d81a21b0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.458+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d81099a0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.459+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd8d4042030 con 0x7fd8d8101dc0 2024-09-21T07:00:22.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.460+0000 7fd8ceffd640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 0x7fd8c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.460+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fd8d41065e0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.460+0000 7fd8dd5ec640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 0x7fd8c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.461+0000 7fd8dd5ec640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 0x7fd8c40b8aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009c20 tx=0x7fd8c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.465+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d40ce1b0 con 0x7fd8d8101dc0 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi028 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi028 to 8546M 2024-09-21T07:00:22.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:22.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:22.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:22.656+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd8d8063800 con 0x7fd8c40b6590 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi028 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi028 to 8546M 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:22.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi028 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi028 to 8546M 2024-09-21T07:00:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:22.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:22.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:22.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:23.298 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:00:22.921+0000 7fa29ffc3640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:00:23.298 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:00:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:00:22.928+0000 7fa297db9640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:23.734 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:23.735 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' 2024-09-21T07:00:23.735 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] boot 2024-09-21T07:00:23.735 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T07:00:23.735 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:23.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] boot 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T07:00:23.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716]' entity='osd.3' 2024-09-21T07:00:23.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: osd.3 [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] boot 2024-09-21T07:00:23.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T07:00:23.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:00:24.682 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:24 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:00:24.682 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:24 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:00:24.682 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:24 smithi129 ceph-mon[34863]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:00:24.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:24 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:00:24.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:24 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:00:24.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:24 smithi181 ceph-mon[34686]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:00:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:24 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:00:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:24 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:00:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:24 smithi028 ceph-mon[31213]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/3973488499' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"}]': finished 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T07:00:25.623 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/3973488499' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"}]': finished 2024-09-21T07:00:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T07:00:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/3973488499' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"} : dispatch 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efcbe4ce-405f-4668-8538-6547a3121baa"}]': finished 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T07:00:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:26.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:26 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/1538154056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:26.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:26 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/1538154056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:26.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:26 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/1538154056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:27 smithi181 ceph-mon[34686]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:27 smithi028 ceph-mon[31213]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:27 smithi129 ceph-mon[34863]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:29.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:29 smithi181 ceph-mon[34686]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:29.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:29 smithi028 ceph-mon[31213]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:29.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:29 smithi129 ceph-mon[34863]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:31.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:31 smithi129 ceph-mon[34863]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:00:31.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:31 smithi181 ceph-mon[34686]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:00:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:31 smithi028 ceph-mon[31213]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:00:33.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:33 smithi129 ceph-mon[34863]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:00:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:00:33.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:33.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:33 smithi181 ceph-mon[34686]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:00:33.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:00:33.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:33.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:33 smithi028 ceph-mon[31213]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:00:33.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:00:33.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:34.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:34 smithi181 ceph-mon[34686]: Deploying daemon osd.4 on smithi129 2024-09-21T07:00:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:34 smithi028 ceph-mon[31213]: Deploying daemon osd.4 on smithi129 2024-09-21T07:00:34.822 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:34 smithi129 ceph-mon[34863]: Deploying daemon osd.4 on smithi129 2024-09-21T07:00:35.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:35 smithi181 ceph-mon[34686]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:00:35.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:35 smithi028 ceph-mon[31213]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:00:35.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:35 smithi129 ceph-mon[34863]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:00:37.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:37 smithi181 ceph-mon[34686]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:00:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:37 smithi028 ceph-mon[31213]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:00:37.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:37 smithi129 ceph-mon[34863]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:00:39.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:39 smithi181 ceph-mon[34686]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:39.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:39 smithi028 ceph-mon[31213]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:39.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:39 smithi129 ceph-mon[34863]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:40.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:40.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:40.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:41.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:41 smithi129 ceph-mon[34863]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:42.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:41 smithi181 ceph-mon[34686]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:42.416 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:41 smithi028 ceph-mon[31213]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:00:43.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.129+0000 7fd8ceffd640 1 -- 172.21.15.129:0/4217858944 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd8d8063800 con 0x7fd8c40b6590 2024-09-21T07:00:43.131 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 4 on host 'smithi129' 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 msgr2=0x7fd8c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 0x7fd8c40b8aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009c20 tx=0x7fd8c8005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 msgr2=0x7fd8d81049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4031a50 comp rx=0 tx=0).stop 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 shutdown_connections 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd8c40b6590 0x7fd8c40b8aa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:43.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8d81037f0 0x7fd8d81a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:43.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8d8102e50 0x7fd8d819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:43.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 --2- 172.21.15.129:0/4217858944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8d8101dc0 0x7fd8d81049a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:43.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 >> 172.21.15.129:0/4217858944 conn(0x7fd8d80fd770 msgr2=0x7fd8d806a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:43.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 shutdown_connections 2024-09-21T07:00:43.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:00:43.132+0000 7fd8e0051640 1 -- 172.21.15.129:0/4217858944 wait complete. 2024-09-21T07:00:43.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:43.833 DEBUG:teuthology.orchestra.run.smithi129:osd.4> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T07:00:43.835 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-09-21T07:00:43.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:00:44.092 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:45.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:45 smithi181 ceph-mon[34686]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:45.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:45 smithi028 ceph-mon[31213]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:45.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:45 smithi129 ceph-mon[34863]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:46.268 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:00:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:00:45.907+0000 7f0fb88c6640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:00:46.527 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:46 smithi181 ceph-mon[34686]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.527 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:46 smithi181 ceph-mon[34686]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:46 smithi028 ceph-mon[31213]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:46 smithi028 ceph-mon[31213]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:46 smithi129 ceph-mon[34863]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:46 smithi129 ceph-mon[34863]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:00:46.639 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T07:00:46.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-09-21T07:00:46.920 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:47.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:47.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:00:47.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T07:00:47.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi129 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi129 to 8544M 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:47.315 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.423+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1295920618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba0105180 msgr2=0x7f7ba010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.423+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1295920618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba0105180 0x7f7ba010bb20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009ca0 tx=0x7f7b9802a950 comp rx=0 tx=0).stop 2024-09-21T07:00:47.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.423+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1295920618 shutdown_connections 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1295920618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba0105180 0x7f7ba010bb20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1295920618 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba01047e0 0x7f7ba0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1295920618 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 0x7f7ba0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1295920618 >> 172.21.15.181:0/1295920618 conn(0x7f7ba00ff0c0 msgr2=0x7f7ba0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1295920618 shutdown_connections 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1295920618 wait complete. 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 Processor -- start 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 -- start start 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 0x7f7ba0199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.424+0000 7f7ba6ab3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba6ab3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba0105180 0x7f7ba019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba6ab3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba010f380 con 0x7f7ba0105180 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba6ab3640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba010f200 con 0x7f7ba0103750 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba6ab3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba010f500 con 0x7f7ba01047e0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:56848/0 (socket says 172.21.15.181:56848) 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 -- 172.21.15.181:0/1222873060 learned_addr learned my addr 172.21.15.181:0/1222873060 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba484f640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 0x7f7ba0199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba5050640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba0105180 0x7f7ba019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 -- 172.21.15.181:0/1222873060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 msgr2=0x7f7ba0199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 0x7f7ba0199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 -- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba0105180 msgr2=0x7f7ba019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba0105180 0x7f7ba019b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 -- 172.21.15.181:0/1222873060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba019b8e0 con 0x7f7ba01047e0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9ffff640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00d950 tx=0x7f7b8c00dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c017070 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b8c00de80 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba019bbd0 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.425+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00f620 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.426+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba01a2360 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.427+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba0103bc0 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.428+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7b8c009c30 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.429+0000 7f7b9dffb640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 0x7f7b900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.429+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3821+0+0 (secure 0 0 0) 0x7f7b8c0e5d20 con 0x7f7ba01047e0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.429+0000 7f7ba484f640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 0x7f7b900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.430+0000 7f7ba484f640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 0x7f7b900b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400abe0 tx=0x7f7b9400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.433+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b8c0ad740 con 0x7f7ba01047e0 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi129 2024-09-21T07:00:47.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi129 to 8544M 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:47.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.606 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:00:47.280+0000 7f0fb4848640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:00:47.607 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:00:47.286+0000 7f0fb0646640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi129 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi129 to 8544M 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:47.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:00:47.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:00:47.620+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7ba0063800 con 0x7f7b900b6590 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:48.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:48.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:00:48.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] boot 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T07:00:49.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] boot 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T07:00:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:49.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:00:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:00:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:00:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: osd.4 [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] boot 2024-09-21T07:00:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T07:00:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:00:50.427 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T07:00:50.427 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/1913937847' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.428 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.428 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"}]': finished 2024-09-21T07:00:50.428 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T07:00:50.428 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:50 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/1913937847' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"}]': finished 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T07:00:50.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:50 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/1913937847' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"} : dispatch 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b58876-da54-434b-b8aa-ce70f8edbb39"}]': finished 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T07:00:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:50 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:00:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:51 smithi028 ceph-mon[31213]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:51 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/880444894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:51.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:51 smithi129 ceph-mon[34863]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:51 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/880444894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:51 smithi181 ceph-mon[34686]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:51 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/880444894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:00:53.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:53 smithi028 ceph-mon[31213]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:53 smithi129 ceph-mon[34863]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:53 smithi181 ceph-mon[34686]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:55.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:55 smithi129 ceph-mon[34863]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:55.646 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:55 smithi181 ceph-mon[34686]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:55.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:55 smithi028 ceph-mon[31213]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:57.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:57 smithi129 ceph-mon[34863]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:57.610 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:57 smithi181 ceph-mon[34686]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:57.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:57 smithi028 ceph-mon[31213]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:59.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:59 smithi129 ceph-mon[34863]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:00:59 smithi129 ceph-mon[34863]: Deploying daemon osd.5 on smithi181 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:59 smithi181 ceph-mon[34686]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:59.607 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:00:59 smithi181 ceph-mon[34686]: Deploying daemon osd.5 on smithi181 2024-09-21T07:00:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:59 smithi028 ceph-mon[31213]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:00:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:00:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:00:59 smithi028 ceph-mon[31213]: Deploying daemon osd.5 on smithi181 2024-09-21T07:01:01.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:01 smithi181 ceph-mon[34686]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:01.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:01 smithi129 ceph-mon[34863]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:01 smithi028 ceph-mon[31213]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:03.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:03 smithi028 ceph-mon[31213]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:03.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:03 smithi129 ceph-mon[34863]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:03.680 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:03 smithi181 ceph-mon[34686]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:05.337 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:05 smithi181 ceph-mon[34686]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:05.337 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:05.337 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:05.338 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:05.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:05 smithi129 ceph-mon[34863]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:05.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:05.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:05.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:05 smithi028 ceph-mon[31213]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:08.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:08.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.837+0000 7f7b9dffb640 1 -- 172.21.15.181:0/1222873060 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7ba0063800 con 0x7f7b900b6590 2024-09-21T07:01:08.839 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-09-21T07:01:08.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 msgr2=0x7f7b900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 0x7f7b900b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400abe0 tx=0x7f7b9400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 msgr2=0x7f7ba019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00d950 tx=0x7f7b8c00dd50 comp rx=0 tx=0).stop 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 shutdown_connections 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7b900b6590 0x7f7b900b8aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ba0105180 0x7f7ba019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba01047e0 0x7f7ba019a5b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 --2- 172.21.15.181:0/1222873060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ba0103750 0x7f7ba0199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.839+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 >> 172.21.15.181:0/1222873060 conn(0x7f7ba00ff0c0 msgr2=0x7f7ba0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.840+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 shutdown_connections 2024-09-21T07:01:08.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:01:08.840+0000 7f7ba6ab3640 1 -- 172.21.15.181:0/1222873060 wait complete. 2024-09-21T07:01:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:09.500 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T07:01:09.503 INFO:tasks.cephadm:Deploying osd.6 on smithi028 with /dev/vg_nvme/lv_2... 2024-09-21T07:01:09.503 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:01:09.769 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:10.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:09 smithi181 ceph-mon[34686]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:10.205 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:09 smithi028 ceph-mon[31213]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:10.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:09 smithi129 ceph-mon[34863]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:11.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:01:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:01:11.037+0000 7f801413a640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:01:12.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:11 smithi181 ceph-mon[34686]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:12.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:11 smithi181 ceph-mon[34686]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:11 smithi181 ceph-mon[34686]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:11 smithi028 ceph-mon[31213]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:11 smithi028 ceph-mon[31213]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:11 smithi028 ceph-mon[31213]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:11 smithi129 ceph-mon[34863]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:11 smithi129 ceph-mon[34863]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:11 smithi129 ceph-mon[34863]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:01:12.605 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:01:12.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi028:vg_nvme/lv_2 2024-09-21T07:01:12.904 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:13.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:01:12.945+0000 7f80100bc640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:01:13.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:01:12.954+0000 7f800beba640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:13.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:13.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:13.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:13.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:13.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 -- 172.21.15.28:0/3285044073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb304103750 msgr2=0x7fb304103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 --2- 172.21.15.28:0/3285044073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb304103750 0x7fb304103bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009900 tx=0x7fb2fc02a480 comp rx=0 tx=0).stop 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 -- 172.21.15.28:0/3285044073 shutdown_connections 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 --2- 172.21.15.28:0/3285044073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304105180 0x7fb30410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 --2- 172.21.15.28:0/3285044073 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3041047e0 0x7fb304104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 --2- 172.21.15.28:0/3285044073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb304103750 0x7fb304103bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 -- 172.21.15.28:0/3285044073 >> 172.21.15.28:0/3285044073 conn(0x7fb3040ff0c0 msgr2=0x7fb304101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 -- 172.21.15.28:0/3285044073 shutdown_connections 2024-09-21T07:01:13.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.510+0000 7fb308bd9640 1 -- 172.21.15.28:0/3285044073 wait complete. 2024-09-21T07:01:13.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 Processor -- start 2024-09-21T07:01:13.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 -- start start 2024-09-21T07:01:13.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304103750 0x7fb30419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb304105180 0x7fb30419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb30410f470 con 0x7fb3041047e0 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb30410f2f0 con 0x7fb304105180 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb308bd9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb30410f5f0 con 0x7fb304103750 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb301d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb301d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38274/0 (socket says 172.21.15.28:38274) 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.511+0000 7fb301d9b640 1 -- 172.21.15.28:0/4112027456 learned_addr learned my addr 172.21.15.28:0/4112027456 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb30259c640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304103750 0x7fb30419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb302d9d640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb304105180 0x7fb30419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 -- 172.21.15.28:0/4112027456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304103750 msgr2=0x7fb30419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304103750 0x7fb30419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 -- 172.21.15.28:0/4112027456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb304105180 msgr2=0x7fb30419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb304105180 0x7fb30419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 -- 172.21.15.28:0/4112027456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30419bb30 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb301d9b640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b4a0 tx=0x7fb2ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec014070 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2ec010ac0 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30419be20 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec017c30 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.512+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041a2520 con 0x7fb3041047e0 2024-09-21T07:01:13.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.513+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30410a930 con 0x7fb3041047e0 2024-09-21T07:01:13.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.515+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb2ec017070 con 0x7fb3041047e0 2024-09-21T07:01:13.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.516+0000 7fb2fb7fe640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.516+0000 7fb30259c640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.516+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4566+0+0 (secure 0 0 0) 0x7fb2ec0e5a30 con 0x7fb3041047e0 2024-09-21T07:01:13.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.517+0000 7fb30259c640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 0x7fb2f00b8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc000c00 tx=0x7fb2fc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:13.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.519+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2ec0b14a0 con 0x7fb3041047e0 2024-09-21T07:01:13.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:13.718+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb304063800 con 0x7fb2f00b6510 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi181 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] boot 2024-09-21T07:01:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T07:01:14.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:14.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:14.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi181 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] boot 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:14.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi181 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: osd.5 [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] boot 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:15.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:14 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:01:15.229 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:14 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:01:15.229 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:14 smithi028 ceph-mon[31213]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:15.229 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:14 smithi028 ceph-mon[31213]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:01:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:14 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:01:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:14 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:01:15.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:14 smithi181 ceph-mon[34686]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:15.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:14 smithi181 ceph-mon[34686]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:01:15.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:14 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:01:15.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:14 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:01:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:14 smithi129 ceph-mon[34863]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:14 smithi129 ceph-mon[34863]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:01:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:15 smithi181 ceph-mon[34686]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 184 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:16.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:15 smithi181 ceph-mon[34686]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:01:16.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:15 smithi028 ceph-mon[31213]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 184 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:16.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:15 smithi028 ceph-mon[31213]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:01:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:15 smithi129 ceph-mon[34863]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 184 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:15 smithi129 ceph-mon[34863]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:01:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"} : dispatch 2024-09-21T07:01:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"}]': finished 2024-09-21T07:01:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:16 smithi181 ceph-mon[34686]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T07:01:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1366666363' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"} : dispatch 2024-09-21T07:01:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"}]': finished 2024-09-21T07:01:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:16 smithi028 ceph-mon[31213]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T07:01:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1366666363' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:17.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"} : dispatch 2024-09-21T07:01:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/699069696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f51f26d7-29dc-408b-af52-ab6dc9843352"}]': finished 2024-09-21T07:01:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:16 smithi129 ceph-mon[34863]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T07:01:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1366666363' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:17 smithi181 ceph-mon[34686]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:17 smithi028 ceph-mon[31213]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:18.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:17 smithi129 ceph-mon[34863]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:20.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:19 smithi181 ceph-mon[34686]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:20.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:19 smithi028 ceph-mon[31213]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:20.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:19 smithi129 ceph-mon[34863]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:22.238 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:21 smithi028 ceph-mon[31213]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:01:22.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:21 smithi181 ceph-mon[34686]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:01:22.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:21 smithi129 ceph-mon[34863]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:01:24.248 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:23 smithi028 ceph-mon[31213]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:01:24.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:23 smithi181 ceph-mon[34686]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:01:24.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:23 smithi129 ceph-mon[34863]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:01:25.258 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:01:25.258 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:25.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:01:25.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:25.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:01:25.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:26.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:25 smithi181 ceph-mon[34686]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:01:26.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:25 smithi181 ceph-mon[34686]: Deploying daemon osd.6 on smithi028 2024-09-21T07:01:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:25 smithi028 ceph-mon[31213]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:01:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:25 smithi028 ceph-mon[31213]: Deploying daemon osd.6 on smithi028 2024-09-21T07:01:26.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:25 smithi129 ceph-mon[34863]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:01:26.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:25 smithi129 ceph-mon[34863]: Deploying daemon osd.6 on smithi028 2024-09-21T07:01:28.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:27 smithi181 ceph-mon[34686]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:01:28.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:27 smithi028 ceph-mon[31213]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:01:28.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:27 smithi129 ceph-mon[34863]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:01:30.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:29 smithi028 ceph-mon[31213]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:29 smithi181 ceph-mon[34686]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:30.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:29 smithi129 ceph-mon[34863]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:31 smithi181 ceph-mon[34686]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:31 smithi028 ceph-mon[31213]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:31 smithi129 ceph-mon[34863]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:01:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:33 smithi181 ceph-mon[34686]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:34.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:33 smithi028 ceph-mon[31213]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:34.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:33 smithi129 ceph-mon[34863]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:35.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.110+0000 7fb2fb7fe640 1 -- 172.21.15.28:0/4112027456 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb304063800 con 0x7fb2f00b6510 2024-09-21T07:01:35.113 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 6 on host 'smithi028' 2024-09-21T07:01:35.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 msgr2=0x7fb2f00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 0x7fb2f00b8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc000c00 tx=0x7fb2fc031400 comp rx=0 tx=0).stop 2024-09-21T07:01:35.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 msgr2=0x7fb30419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b4a0 tx=0x7fb2ec00b960 comp rx=0 tx=0).stop 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 shutdown_connections 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb304105180 0x7fb30419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3041047e0 0x7fb30419a770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 --2- 172.21.15.28:0/4112027456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb304103750 0x7fb30419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 >> 172.21.15.28:0/4112027456 conn(0x7fb3040ff0c0 msgr2=0x7fb304107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 shutdown_connections 2024-09-21T07:01:35.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:01:35.113+0000 7fb308bd9640 1 -- 172.21.15.28:0/4112027456 wait complete. 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:35 smithi028 ceph-mon[31213]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:35 smithi129 ceph-mon[34863]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:35 smithi181 ceph-mon[34686]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:35.831 DEBUG:teuthology.orchestra.run.smithi028:osd.6> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T07:01:35.834 INFO:tasks.cephadm:Deploying osd.7 on smithi129 with /dev/vg_nvme/lv_2... 2024-09-21T07:01:35.834 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:01:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:01:36.104 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:36.104 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:36.104 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:36.211 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:36.211 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:36.211 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:37.226 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:37 smithi028 ceph-mon[31213]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:37.226 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:01:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:01:37.138+0000 7f22334db640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:01:37.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:37 smithi129 ceph-mon[34863]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:37.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:37 smithi181 ceph-mon[34686]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:38 smithi028 ceph-mon[31213]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:01:38.328 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:38 smithi129 ceph-mon[34863]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:01:38.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:38 smithi181 ceph-mon[34686]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:01:38.704 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:01:38.731 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_2 2024-09-21T07:01:38.995 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:39.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi028 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi028 to 5697M 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:39.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:39 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- 172.21.15.129:0/4260004404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58103700 msgr2=0x7f1e58103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/4260004404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58103700 0x7f1e58103b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009900 tx=0x7f1e4802a480 comp rx=0 tx=0).stop 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- 172.21.15.129:0/4260004404 shutdown_connections 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/4260004404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e581040a0 0x7f1e5810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/4260004404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58103700 0x7f1e58103b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/4260004404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e58102670 0x7f1e58102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- 172.21.15.129:0/4260004404 >> 172.21.15.129:0/4260004404 conn(0x7f1e580fdfe0 msgr2=0x7f1e58100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- 172.21.15.129:0/4260004404 shutdown_connections 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- 172.21.15.129:0/4260004404 wait complete. 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 Processor -- start 2024-09-21T07:01:39.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.487+0000 7f1e5ef32640 1 -- start start 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e58103700 0x7f1e5819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e581040a0 0x7f1e581a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5810e2a0 con 0x7f1e58103700 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5810e120 con 0x7f1e58102670 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5810e420 con 0x7f1e581040a0 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:52546/0 (socket says 172.21.15.129:52546) 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 -- 172.21.15.129:0/363819440 learned_addr learned my addr 172.21.15.129:0/363819440 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 -- 172.21.15.129:0/363819440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e581040a0 msgr2=0x7f1e581a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e581040a0 0x7f1e581a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 -- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e58103700 msgr2=0x7f1e5819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e58103700 0x7f1e5819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 -- 172.21.15.129:0/363819440 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e581a1a10 con 0x7f1e58102670 2024-09-21T07:01:39.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ccce640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c920 tx=0x7f1e5400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54007c70 con 0x7f1e58102670 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e54007e10 con 0x7f1e58102670 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e581a1d00 con 0x7f1e58102670 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.488+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54018820 con 0x7f1e58102670 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.489+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e581a21e0 con 0x7f1e58102670 2024-09-21T07:01:39.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.490+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e58109830 con 0x7f1e58102670 2024-09-21T07:01:39.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.491+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1e5400f450 con 0x7f1e58102670 2024-09-21T07:01:39.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.492+0000 7f1e4dffb640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 0x7f1e400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:39.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.492+0000 7f1e4ffff640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 0x7f1e400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:39.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.492+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4685+0+0 (secure 0 0 0) 0x7f1e540e6920 con 0x7f1e58102670 2024-09-21T07:01:39.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.493+0000 7f1e4ffff640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 0x7f1e400b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1e48031500 tx=0x7f1e48031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:39.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.496+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e54014030 con 0x7f1e58102670 2024-09-21T07:01:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi028 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi028 to 5697M 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:39.521 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:39.521 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:39 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.548 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:01:39.067+0000 7f222f45d640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:01:39.548 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:01:39.076+0000 7f222b25b640 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi028 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi028 to 5697M 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:39.550 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:39.550 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:39 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:39.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:01:39.683+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1e58063800 con 0x7f1e400b6510 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:40.315 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:40.316 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:40.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:01:40.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:01:40.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:40.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:40.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:40.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:40.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] boot 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:41.346 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:41 smithi129 ceph-mon[34863]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:01:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:01:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] boot 2024-09-21T07:01:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T07:01:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:41.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:41 smithi181 ceph-mon[34686]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: osd.6 [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] boot 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:01:41.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:41 smithi028 ceph-mon[31213]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:01:42.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:42 smithi129 ceph-mon[34863]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:01:42.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:42 smithi181 ceph-mon[34686]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:01:42.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:42 smithi028 ceph-mon[31213]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:01:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/3743437888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"}]': finished 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:43.647 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:43 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/3003847097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/3743437888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"}]': finished 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:43.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:43 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/3003847097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/3743437888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"} : dispatch 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e70aae7-a7da-4d72-9e11-46cb44c01307"}]': finished 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:43.649 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:43 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/3003847097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:45.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:45 smithi028 ceph-mon[31213]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:45.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:45 smithi129 ceph-mon[34863]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:45 smithi181 ceph-mon[34686]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:47.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:47 smithi028 ceph-mon[31213]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:47.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:47 smithi129 ceph-mon[34863]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:47.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:47 smithi181 ceph-mon[34686]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:49.510 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:49 smithi129 ceph-mon[34863]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:49.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:49 smithi028 ceph-mon[31213]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:49 smithi181 ceph-mon[34686]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:51.545 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:51 smithi129 ceph-mon[34863]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:51.545 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:01:51.545 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:51.545 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:51 smithi129 ceph-mon[34863]: Deploying daemon osd.7 on smithi129 2024-09-21T07:01:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:51 smithi028 ceph-mon[31213]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:01:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:51 smithi028 ceph-mon[31213]: Deploying daemon osd.7 on smithi129 2024-09-21T07:01:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:51 smithi181 ceph-mon[34686]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:01:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:51 smithi181 ceph-mon[34686]: Deploying daemon osd.7 on smithi129 2024-09-21T07:01:53.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:53 smithi028 ceph-mon[31213]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:53 smithi129 ceph-mon[34863]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:53 smithi181 ceph-mon[34686]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:55.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:55 smithi028 ceph-mon[31213]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:55.561 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:55 smithi129 ceph-mon[34863]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:55.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:55 smithi181 ceph-mon[34686]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:57.545 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:57 smithi129 ceph-mon[34863]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:57.546 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:57.546 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:57.546 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:57.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:57 smithi028 ceph-mon[31213]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:57.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:57 smithi181 ceph-mon[34686]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:01:59.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:01:59 smithi028 ceph-mon[31213]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:59.549 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:01:59 smithi129 ceph-mon[34863]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:01:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:01:59 smithi181 ceph-mon[34686]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:00.892 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 7 on host 'smithi129' 2024-09-21T07:02:00.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.890+0000 7f1e4dffb640 1 -- 172.21.15.129:0/363819440 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e58063800 con 0x7f1e400b6510 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 msgr2=0x7f1e400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 0x7f1e400b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1e48031500 tx=0x7f1e48031400 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 msgr2=0x7f1e5806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c920 tx=0x7f1e5400cde0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 shutdown_connections 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f1e400b6510 0x7f1e400b8a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e581040a0 0x7f1e581a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e58103700 0x7f1e5819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 --2- 172.21.15.129:0/363819440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e58102670 0x7f1e5806c3a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 >> 172.21.15.129:0/363819440 conn(0x7f1e580fdfe0 msgr2=0x7f1e58106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 shutdown_connections 2024-09-21T07:02:00.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:00.893+0000 7f1e5ef32640 1 -- 172.21.15.129:0/363819440 wait complete. 2024-09-21T07:02:01.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:01.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:00 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:01.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:01.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:00 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:01.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:00 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:01.576 DEBUG:teuthology.orchestra.run.smithi129:osd.7> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T07:02:01.578 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-09-21T07:02:01.578 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:02:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:02:02.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:01 smithi129 ceph-mon[34863]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:02.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:02.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:02.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:01 smithi181 ceph-mon[34686]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:02.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:02.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:02.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:01 smithi028 ceph-mon[31213]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:02.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:02.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:03.357 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:02:02 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:02:02.951+0000 7f9dbe519640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:02:04.012 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:03 smithi129 ceph-mon[34863]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:04.013 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:03 smithi129 ceph-mon[34863]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.013 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:03 smithi129 ceph-mon[34863]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:03 smithi181 ceph-mon[34686]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:04.224 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:03 smithi181 ceph-mon[34686]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.224 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:03 smithi181 ceph-mon[34686]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:03 smithi028 ceph-mon[31213]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:04.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:03 smithi028 ceph-mon[31213]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:03 smithi028 ceph-mon[31213]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:02:04.543 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T07:02:04.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-09-21T07:02:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:02:05.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:05.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:04 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- 172.21.15.181:0/570665977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b641047e0 msgr2=0x7f9b64104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/570665977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b641047e0 0x7f9b64104bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009900 tx=0x7f9b5402a480 comp rx=0 tx=0).stop 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- 172.21.15.181:0/570665977 shutdown_connections 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/570665977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 0x7f9b6410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/570665977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b641047e0 0x7f9b64104bf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/570665977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b64103750 0x7f9b64103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- 172.21.15.181:0/570665977 >> 172.21.15.181:0/570665977 conn(0x7f9b640ff0c0 msgr2=0x7f9b64101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- 172.21.15.181:0/570665977 shutdown_connections 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- 172.21.15.181:0/570665977 wait complete. 2024-09-21T07:02:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 Processor -- start 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.277+0000 7f9b6bb75640 1 -- start start 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b641047e0 0x7f9b6419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 0x7f9b6419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6410f3a0 con 0x7f9b64105180 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6410f220 con 0x7f9b641047e0 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6410f520 con 0x7f9b64103750 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49088/0 (socket says 172.21.15.181:49088) 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 -- 172.21.15.181:0/3423001393 learned_addr learned my addr 172.21.15.181:0/3423001393 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69110640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b641047e0 0x7f9b6419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6a112640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 0x7f9b6419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 -- 172.21.15.181:0/3423001393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b641047e0 msgr2=0x7f9b6419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b641047e0 0x7f9b6419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 -- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 msgr2=0x7f9b6419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 0x7f9b6419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 -- 172.21.15.181:0/3423001393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6419ba00 con 0x7f9b64103750 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b69911640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9f0 tx=0x7f9b6000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000cd80 con 0x7f9b64103750 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600054d0 con 0x7f9b64103750 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6419bcf0 con 0x7f9b64103750 2024-09-21T07:02:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.278+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60010690 con 0x7f9b64103750 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.279+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b641a23f0 con 0x7f9b64103750 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.280+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b6410a930 con 0x7f9b64103750 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.281+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9b60004e30 con 0x7f9b64103750 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.282+0000 7f9b5affd640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 0x7f9b500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.282+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5117+0+0 (secure 0 0 0) 0x7f9b600e6bb0 con 0x7f9b64103750 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.282+0000 7f9b69110640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 0x7f9b500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.282+0000 7f9b69110640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 0x7f9b500b8aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b54000c00 tx=0x7f9b54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.285+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b600ae0c0 con 0x7f9b64103750 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:05.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:05.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:04 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.325 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.326 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:05.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:05.327 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:04 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:05.473+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9b64063800 con 0x7f9b500b6590 2024-09-21T07:02:05.606 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:02:05.323+0000 7f9dba49b640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:02:05.606 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:02:05.334+0000 7f9db2291640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi129 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi129 to 5696M 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='osd.7 ' entity='osd.7' 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:06.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi129 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi129 to 5696M 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:02:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='osd.7 ' entity='osd.7' 2024-09-21T07:02:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:06.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi129 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi129 to 5696M 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='osd.7 ' entity='osd.7' 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] boot 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T07:02:07.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:06 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] boot 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T07:02:07.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:06 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:07.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: osd.7 [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] boot 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T07:02:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:06 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/2966937296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"}]': finished 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: osdmap e46: 9 total, 8 up, 9 in 2024-09-21T07:02:08.204 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/2966937296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"}]': finished 2024-09-21T07:02:08.234 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: osdmap e46: 9 total, 8 up, 9 in 2024-09-21T07:02:08.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/2966937296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"} : dispatch 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f14ae0-ab04-4993-b332-289a45f543b6"}]': finished 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: osdmap e46: 9 total, 8 up, 9 in 2024-09-21T07:02:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:09.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:08 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/1503359645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:09.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:08 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/1503359645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:08 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/1503359645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:10.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:09 smithi181 ceph-mon[34686]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:10.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:09 smithi028 ceph-mon[31213]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:10.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:09 smithi129 ceph-mon[34863]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:11 smithi181 ceph-mon[34686]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:11 smithi028 ceph-mon[31213]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:12.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:11 smithi129 ceph-mon[34863]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:14.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:13 smithi181 ceph-mon[34686]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:02:14.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:13 smithi028 ceph-mon[31213]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:02:14.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:13 smithi129 ceph-mon[34863]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:02:16.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:15 smithi181 ceph-mon[34686]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:16.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:15 smithi028 ceph-mon[31213]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:15 smithi129 ceph-mon[34863]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:17.210 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:02:17.210 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:02:17.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:17.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:02:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:18.202 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:17 smithi181 ceph-mon[34686]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:18.203 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:17 smithi181 ceph-mon[34686]: Deploying daemon osd.8 on smithi181 2024-09-21T07:02:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:17 smithi028 ceph-mon[31213]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:17 smithi028 ceph-mon[31213]: Deploying daemon osd.8 on smithi181 2024-09-21T07:02:18.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:17 smithi129 ceph-mon[34863]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:18.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:17 smithi129 ceph-mon[34863]: Deploying daemon osd.8 on smithi181 2024-09-21T07:02:20.211 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:19 smithi181 ceph-mon[34686]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:20.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:19 smithi028 ceph-mon[31213]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:20.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:19 smithi129 ceph-mon[34863]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:22.205 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:21 smithi181 ceph-mon[34686]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:21 smithi028 ceph-mon[31213]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:22.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:21 smithi129 ceph-mon[34863]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:23.210 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:23.211 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:23.211 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:23.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:24.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:23 smithi181 ceph-mon[34686]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:23 smithi028 ceph-mon[31213]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:24.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:23 smithi129 ceph-mon[34863]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:26.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:26.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:26.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:26.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:26.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:26.797 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-09-21T07:02:26.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.795+0000 7f9b5affd640 1 -- 172.21.15.181:0/3423001393 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b64063800 con 0x7f9b500b6590 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 msgr2=0x7f9b500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 0x7f9b500b8aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b54000c00 tx=0x7f9b54031400 comp rx=0 tx=0).stop 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 msgr2=0x7f9b64199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9f0 tx=0x7f9b6000edf0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 shutdown_connections 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9b500b6590 0x7f9b500b8aa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b64105180 0x7f9b6419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b641047e0 0x7f9b6419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 --2- 172.21.15.181:0/3423001393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b64103750 0x7f9b64199fd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 >> 172.21.15.181:0/3423001393 conn(0x7f9b640ff0c0 msgr2=0x7f9b64107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:26.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 shutdown_connections 2024-09-21T07:02:26.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:02:26.798+0000 7f9b6bb75640 1 -- 172.21.15.181:0/3423001393 wait complete. 2024-09-21T07:02:27.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:26 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:27.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:26 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:26 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:26 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:27.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:26 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:26 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:26 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:27.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:26 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:26 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:27.446 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T07:02:27.448 INFO:tasks.cephadm:Deploying osd.9 on smithi028 with /dev/vg_nvme/lv_1... 2024-09-21T07:02:27.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:02:27.720 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:02:28.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:27 smithi181 ceph-mon[34686]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:28.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:27 smithi028 ceph-mon[31213]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:28.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:27 smithi129 ceph-mon[34863]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:28.754 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:02:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:02:28.395+0000 7f00f20ef640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:02:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:28 smithi181 ceph-mon[34686]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:29.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:28 smithi181 ceph-mon[34686]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:29.194 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:28 smithi028 ceph-mon[31213]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:29.194 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:28 smithi028 ceph-mon[31213]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:29.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:28 smithi129 ceph-mon[34863]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:29.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:28 smithi129 ceph-mon[34863]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:02:30.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:30.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:02:30.188 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:02:30.188 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.188 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:30.188 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:29 smithi028 ceph-mon[31213]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:30.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:02:30.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:02:30.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:30.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-mon[34686]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:02:29.974+0000 7f00ee071640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:02:30.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:02:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:02:29.986+0000 7f00e9e6f640 -1 osd.8 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:30.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:30.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:02:30.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:02:30.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: from='osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:30.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:29 smithi129 ceph-mon[34863]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:02:30.533 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:02:30.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi028:vg_nvme/lv_1 2024-09-21T07:02:30.824 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:02:31.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:02:31.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:02:31.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] boot 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: osdmap e49: 9 total, 9 up, 9 in 2024-09-21T07:02:31.218 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] boot 2024-09-21T07:02:31.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: osdmap e49: 9 total, 9 up, 9 in 2024-09-21T07:02:31.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 -- 172.21.15.28:0/2275869173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 msgr2=0x7f2040106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 --2- 172.21.15.28:0/2275869173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040106390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2030009900 tx=0x7f203002a410 comp rx=0 tx=0).stop 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 -- 172.21.15.28:0/2275869173 shutdown_connections 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 --2- 172.21.15.28:0/2275869173 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2040109470 0x7f204010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 --2- 172.21.15.28:0/2275869173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f20401068d0 0x7f2040108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 --2- 172.21.15.28:0/2275869173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040106390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:31.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 -- 172.21.15.28:0/2275869173 >> 172.21.15.28:0/2275869173 conn(0x7f20400fdfb0 msgr2=0x7f2040100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:31.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 -- 172.21.15.28:0/2275869173 shutdown_connections 2024-09-21T07:02:31.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.312+0000 7f2046748640 1 -- 172.21.15.28:0/2275869173 wait complete. 2024-09-21T07:02:31.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 Processor -- start 2024-09-21T07:02:31.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 -- start start 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20401068d0 0x7f204019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2040109470 0x7f204019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f204010f360 con 0x7f204006b980 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f204010f1e0 con 0x7f2040109470 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f2046748640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f204010f4e0 con 0x7f20401068d0 2024-09-21T07:02:31.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f203ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f203ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49288/0 (socket says 172.21.15.28:49288) 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.313+0000 7f203ffff640 1 -- 172.21.15.28:0/3015773535 learned_addr learned my addr 172.21.15.28:0/3015773535 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f2037fff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20401068d0 0x7f204019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f2044ce5640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2040109470 0x7f204019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 -- 172.21.15.28:0/3015773535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20401068d0 msgr2=0x7f204019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20401068d0 0x7f204019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 -- 172.21.15.28:0/3015773535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2040109470 msgr2=0x7f204019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2040109470 0x7f204019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 -- 172.21.15.28:0/3015773535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204019ba20 con 0x7f204006b980 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203ffff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2030006010 tx=0x7f2030031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203003f030 con 0x7f204006b980 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2030003aa0 con 0x7f204006b980 2024-09-21T07:02:31.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204019bcb0 con 0x7f204006b980 2024-09-21T07:02:31.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030035070 con 0x7f204006b980 2024-09-21T07:02:31.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.314+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401a2410 con 0x7f204006b980 2024-09-21T07:02:31.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.316+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20400ffad0 con 0x7f204006b980 2024-09-21T07:02:31.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.317+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2030042030 con 0x7f204006b980 2024-09-21T07:02:31.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.318+0000 7f203dffb640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 0x7f202c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:31.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.318+0000 7f2037fff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 0x7f202c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:31.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.318+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5862+0+0 (secure 0 0 0) 0x7f2030106f00 con 0x7f204006b980 2024-09-21T07:02:31.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.319+0000 7f2037fff640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 0x7f202c0b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2028009bd0 tx=0x7f2028005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:31.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.322+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20300d2460 con 0x7f204006b980 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: osd.8 [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] boot 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: osdmap e49: 9 total, 9 up, 9 in 2024-09-21T07:02:31.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:02:31.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:31.521+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2040063800 con 0x7f202c0b6590 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi181 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:32.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:32.229 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:32.229 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:31 smithi028 ceph-mon[31213]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T07:02:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi181 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:31 smithi181 ceph-mon[34686]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T07:02:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi181 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:31 smithi129 ceph-mon[34863]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T07:02:33.117 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:32 smithi028 ceph-mon[31213]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:33.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:32 smithi181 ceph-mon[34686]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:33.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:32 smithi129 ceph-mon[34863]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:02:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"} : dispatch 2024-09-21T07:02:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"}]': finished 2024-09-21T07:02:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: osdmap e52: 10 total, 9 up, 10 in 2024-09-21T07:02:34.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"} : dispatch 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"}]': finished 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: osdmap e52: 10 total, 9 up, 10 in 2024-09-21T07:02:34.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:34.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:02:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"} : dispatch 2024-09-21T07:02:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/842094553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf"}]': finished 2024-09-21T07:02:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: osdmap e52: 10 total, 9 up, 10 in 2024-09-21T07:02:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:35.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:34 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3167461318' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:35.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:34 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3167461318' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:35.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:34 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3167461318' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:35 smithi181 ceph-mon[34686]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:36.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:35 smithi028 ceph-mon[31213]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:36.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:35 smithi129 ceph-mon[34863]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:38.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:37 smithi181 ceph-mon[34686]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:37 smithi028 ceph-mon[31213]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:38.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:37 smithi129 ceph-mon[34863]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:40.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:40 smithi028 ceph-mon[31213]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:02:40.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:40 smithi181 ceph-mon[34686]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:02:40.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:40 smithi129 ceph-mon[34863]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:02:42.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:42 smithi181 ceph-mon[34686]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:42.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:42 smithi028 ceph-mon[31213]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:42.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:42 smithi129 ceph-mon[34863]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:02:43.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:02:43.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:43.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:02:43.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:43.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:02:43.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:44.241 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:44 smithi028 ceph-mon[31213]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:44.241 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:44 smithi028 ceph-mon[31213]: Deploying daemon osd.9 on smithi028 2024-09-21T07:02:44.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:44 smithi181 ceph-mon[34686]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:44.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:44 smithi181 ceph-mon[34686]: Deploying daemon osd.9 on smithi028 2024-09-21T07:02:44.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:44 smithi129 ceph-mon[34863]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:02:44.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:44 smithi129 ceph-mon[34863]: Deploying daemon osd.9 on smithi028 2024-09-21T07:02:46.211 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:46 smithi028 ceph-mon[31213]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:46.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:46 smithi181 ceph-mon[34686]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:46.465 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:46 smithi129 ceph-mon[34863]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:02:47.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:47 smithi129 ceph-mon[34863]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:47.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:47 smithi028 ceph-mon[31213]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:47.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:47 smithi181 ceph-mon[34686]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:49.506 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:49 smithi028 ceph-mon[31213]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:49.506 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:49.507 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:49.507 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:49 smithi129 ceph-mon[34863]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:49 smithi181 ceph-mon[34686]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:02:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:51 smithi028 ceph-mon[31213]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:51.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:51 smithi129 ceph-mon[34863]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:51 smithi181 ceph-mon[34686]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:51.915 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 9 on host 'smithi028' 2024-09-21T07:02:51.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.913+0000 7f203dffb640 1 -- 172.21.15.28:0/3015773535 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2040063800 con 0x7f202c0b6590 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 msgr2=0x7f202c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 0x7f202c0b8aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2028009bd0 tx=0x7f2028005f90 comp rx=0 tx=0).stop 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 msgr2=0x7f2040199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2030006010 tx=0x7f2030031a50 comp rx=0 tx=0).stop 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 shutdown_connections 2024-09-21T07:02:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f202c0b6590 0x7f202c0b8aa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2040109470 0x7f204019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20401068d0 0x7f204019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 --2- 172.21.15.28:0/3015773535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f204006b980 0x7f2040199ff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 >> 172.21.15.28:0/3015773535 conn(0x7f20400fdfb0 msgr2=0x7f2040104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 shutdown_connections 2024-09-21T07:02:51.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:02:51.915+0000 7f2046748640 1 -- 172.21.15.28:0/3015773535 wait complete. 2024-09-21T07:02:52.541 DEBUG:teuthology.orchestra.run.smithi028:osd.9> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T07:02:52.543 INFO:tasks.cephadm:Deploying osd.10 on smithi129 with /dev/vg_nvme/lv_1... 2024-09-21T07:02:52.543 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:02:52.802 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:02:53.162 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.162 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.162 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.162 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.197 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.197 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.197 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.197 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:53.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:54.224 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:53 smithi129 ceph-mon[34863]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:54.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:53 smithi181 ceph-mon[34686]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:54.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:53 smithi028 ceph-mon[31213]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:55.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:02:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:02:54.944+0000 7fe7fc256640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:02:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-21T07:02:55.638 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi129:vg_nvme/lv_1 2024-09-21T07:02:55.893 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.163 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.164 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:56.164 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:56.164 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:02:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:56.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:56.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 -- 172.21.15.129:0/4102826795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 msgr2=0x7fd96c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 --2- 172.21.15.129:0/4102826795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c103ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009860 tx=0x7fd95c02a3d0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 -- 172.21.15.129:0/4102826795 shutdown_connections 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 --2- 172.21.15.129:0/4102826795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 --2- 172.21.15.129:0/4102826795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c103ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 --2- 172.21.15.129:0/4102826795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 -- 172.21.15.129:0/4102826795 >> 172.21.15.129:0/4102826795 conn(0x7fd96c0fdfb0 msgr2=0x7fd96c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 -- 172.21.15.129:0/4102826795 shutdown_connections 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.378+0000 7fd973d18640 1 -- 172.21.15.129:0/4102826795 wait complete. 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 Processor -- start 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 -- start start 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:56.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c10e2c0 con 0x7fd96c104070 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c10e140 con 0x7fd96c102640 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd973d18640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c10e440 con 0x7fd96c1036d0 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:54776/0 (socket says 172.21.15.129:54776) 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 -- 172.21.15.129:0/2746903625 learned_addr learned my addr 172.21.15.129:0/2746903625 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd9712b3640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd9722b5640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 -- 172.21.15.129:0/2746903625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 msgr2=0x7fd96c1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 -- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 msgr2=0x7fd96c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd971ab4640 1 -- 172.21.15.129:0/2746903625 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c19a8b0 con 0x7fd96c102640 2024-09-21T07:02:56.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd9722b5640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.379+0000 7fd9712b3640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd971ab4640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd96800ead0 tx=0x7fd96800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800bc90 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c19aba0 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd96800be30 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968017410 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.380+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c06b030 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.381+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c102ab0 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.383+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd9680035f0 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.384+0000 7fd962ffd640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 0x7fd9580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.384+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5965+0+0 (secure 0 0 0) 0x7fd9680e8640 con 0x7fd96c102640 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.384+0000 7fd9712b3640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 0x7fd9580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.385+0000 7fd9712b3640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 0x7fd9580b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd95c02a9c0 tx=0x7fd95c030980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:56.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.387+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9680af760 con 0x7fd96c102640 2024-09-21T07:02:56.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:02:56.583+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd96c1093a0 con 0x7fd9580b6510 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi028 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi028 to 4273M 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:57.236 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:57.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi028 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi028 to 4273M 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:57.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:57.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:57.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:57.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:57.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:02:56.931+0000 7fe7f81d8640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:02:57.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:02:56.951+0000 7fe7f3fd6640 -1 osd.9 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi028 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi028 to 4273M 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]} : dispatch 2024-09-21T07:02:57.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:57.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:58.082 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:57 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:58.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:58.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:58.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:02:58.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:02:58.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:58.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:57 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi129:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: from='osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:58.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:57 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:59.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:58 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:02:59.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:58 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:02:59.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:58 smithi181 ceph-mon[34686]: osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] boot 2024-09-21T07:02:59.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:58 smithi181 ceph-mon[34686]: osdmap e55: 10 total, 10 up, 10 in 2024-09-21T07:02:59.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:58 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:58 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:02:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:58 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:02:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:58 smithi028 ceph-mon[31213]: osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] boot 2024-09-21T07:02:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:58 smithi028 ceph-mon[31213]: osdmap e55: 10 total, 10 up, 10 in 2024-09-21T07:02:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:58 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:02:59.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:58 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:02:59.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:58 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:02:59.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:58 smithi129 ceph-mon[34863]: osd.9 [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] boot 2024-09-21T07:02:59.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:58 smithi129 ceph-mon[34863]: osdmap e55: 10 total, 10 up, 10 in 2024-09-21T07:02:59.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:58 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:03:00.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:03:00.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/3750553518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"}]': finished 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: osdmap e57: 11 total, 10 up, 11 in 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:00.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:02:59 smithi129 ceph-mon[34863]: from='client.? 172.21.15.129:0/1805056855' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:03:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T07:03:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/3750553518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"}]': finished 2024-09-21T07:03:00.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: osdmap e57: 11 total, 10 up, 11 in 2024-09-21T07:03:00.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:00.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:02:59 smithi181 ceph-mon[34686]: from='client.? 172.21.15.129:0/1805056855' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/3750553518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"} : dispatch 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6135ba7-636d-41aa-824b-112eb23712f2"}]': finished 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: osdmap e57: 11 total, 10 up, 11 in 2024-09-21T07:03:00.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:00.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:02:59 smithi028 ceph-mon[31213]: from='client.? 172.21.15.129:0/1805056855' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:02.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:01 smithi181 ceph-mon[34686]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:02.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:01 smithi028 ceph-mon[31213]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:02.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:01 smithi129 ceph-mon[34863]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:04.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:03 smithi181 ceph-mon[34686]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:04.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:03 smithi028 ceph-mon[31213]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:04.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:03 smithi129 ceph-mon[34863]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:06.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:05 smithi129 ceph-mon[34863]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:06.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:05 smithi181 ceph-mon[34686]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:05 smithi028 ceph-mon[31213]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:07.983 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:07 smithi129 ceph-mon[34863]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:07 smithi181 ceph-mon[34686]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:08.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:07 smithi028 ceph-mon[31213]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:09.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:03:09.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:08 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:09.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:08 smithi181 ceph-mon[34686]: Deploying daemon osd.10 on smithi129 2024-09-21T07:03:09.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:03:09.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:08 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:09.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:08 smithi028 ceph-mon[31213]: Deploying daemon osd.10 on smithi129 2024-09-21T07:03:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:03:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:08 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:08 smithi129 ceph-mon[34863]: Deploying daemon osd.10 on smithi129 2024-09-21T07:03:10.075 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:09 smithi129 ceph-mon[34863]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:10.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:09 smithi181 ceph-mon[34686]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:10.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:09 smithi028 ceph-mon[31213]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:12.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:11 smithi129 ceph-mon[34863]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:11 smithi181 ceph-mon[34686]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:11 smithi028 ceph-mon[31213]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:14.139 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:13 smithi129 ceph-mon[34863]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:13 smithi181 ceph-mon[34686]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:14.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:13 smithi028 ceph-mon[31213]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:14 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:14 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:14 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:14 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:14 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:14 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:15.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:14 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:14 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:14 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:16.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:15 smithi129 ceph-mon[34863]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:15 smithi181 ceph-mon[34686]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:16.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:15 smithi028 ceph-mon[31213]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:17.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.948+0000 7fd962ffd640 1 -- 172.21.15.129:0/2746903625 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd96c1093a0 con 0x7fd9580b6510 2024-09-21T07:03:17.950 INFO:teuthology.orchestra.run.smithi129.stdout:Created osd(s) 10 on host 'smithi129' 2024-09-21T07:03:17.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 msgr2=0x7fd9580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:17.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 0x7fd9580b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd95c02a9c0 tx=0x7fd95c030980 comp rx=0 tx=0).stop 2024-09-21T07:03:17.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 msgr2=0x7fd96c198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:17.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd96800ead0 tx=0x7fd96800ef90 comp rx=0 tx=0).stop 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 shutdown_connections 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd9580b6510 0x7fd9580b8a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd96c104070 0x7fd96c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd96c1036d0 0x7fd96c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 --2- 172.21.15.129:0/2746903625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd96c102640 0x7fd96c198e80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 >> 172.21.15.129:0/2746903625 conn(0x7fd96c0fdfb0 msgr2=0x7fd96c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.950+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 shutdown_connections 2024-09-21T07:03:17.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-21T07:03:17.951+0000 7fd973d18640 1 -- 172.21.15.129:0/2746903625 wait complete. 2024-09-21T07:03:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:17 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:17 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.317 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:18.318 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.318 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:17 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:18.684 DEBUG:teuthology.orchestra.run.smithi129:osd.10> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T07:03:18.687 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-09-21T07:03:18.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:03:18.945 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:20.079 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:19 smithi129 ceph-mon[34863]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:20.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:19 smithi181 ceph-mon[34686]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:20.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:19 smithi028 ceph-mon[31213]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:20.356 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:03:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:03:20.077+0000 7f5652b43640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:03:21.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:20 smithi181 ceph-mon[34686]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.031 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:20 smithi181 ceph-mon[34686]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:20 smithi028 ceph-mon[31213]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:20 smithi028 ceph-mon[31213]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:20 smithi129 ceph-mon[34863]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:20 smithi129 ceph-mon[34863]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:03:21.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T07:03:21.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-09-21T07:03:22.002 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:22.002 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:03:22.002 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T07:03:22.002 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.002 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:22.003 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.125 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:22.247 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:22.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:21 smithi028 ceph-mon[31213]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:21 smithi028 ceph-mon[31213]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]} : dispatch 2024-09-21T07:03:22.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:22.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:22.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 -- 172.21.15.181:0/2431689061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478105780 msgr2=0x7f5478107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:22.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 --2- 172.21.15.181:0/2431689061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478105780 0x7f5478107c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5464009900 tx=0x7f546402a410 comp rx=0 tx=0).stop 2024-09-21T07:03:22.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 -- 172.21.15.181:0/2431689061 shutdown_connections 2024-09-21T07:03:22.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 --2- 172.21.15.181:0/2431689061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54781083a0 0x7f547810a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 --2- 172.21.15.181:0/2431689061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478105780 0x7f5478107c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 --2- 172.21.15.181:0/2431689061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5478102d00 0x7f5478105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 -- 172.21.15.181:0/2431689061 >> 172.21.15.181:0/2431689061 conn(0x7f54780fd760 msgr2=0x7f54780ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.659+0000 7f547eba4640 1 -- 172.21.15.181:0/2431689061 shutdown_connections 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 -- 172.21.15.181:0/2431689061 wait complete. 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 Processor -- start 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 -- start start 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5478105780 0x7f5478103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 0x7f5478103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f547810e350 con 0x7f5478105780 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f547810e1d0 con 0x7f54781083a0 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547eba4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f547810e4d0 con 0x7f5478102d00 2024-09-21T07:03:22.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547c940640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547c940640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53542/0 (socket says 172.21.15.181:53542) 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.660+0000 7f547c940640 1 -- 172.21.15.181:0/1940964792 learned_addr learned my addr 172.21.15.181:0/1940964792 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f5477fff640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5478105780 0x7f5478103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547d141640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 0x7f5478103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 -- 172.21.15.181:0/1940964792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 msgr2=0x7f5478103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 0x7f5478103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 -- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5478105780 msgr2=0x7f5478103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5478105780 0x7f5478103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 -- 172.21.15.181:0/1940964792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5478103de0 con 0x7f5478102d00 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547d141640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 0x7f5478103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547c940640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c920 tx=0x7f546c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c007c70 con 0x7f5478102d00 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c007e10 con 0x7f5478102d00 2024-09-21T07:03:22.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781a40a0 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c018820 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.661+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781a4570 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.662+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54781a4800 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.664+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f546c00f450 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.664+0000 7f5475ffb640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 0x7f54680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.665+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6414+0+0 (secure 0 0 0) 0x7f546c0e6ee0 con 0x7f5478102d00 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.665+0000 7f5477fff640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 0x7f54680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.665+0000 7f5477fff640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 0x7f54680b8aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5464006010 tx=0x7f54640314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:22.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.668+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f546c014030 con 0x7f5478102d00 2024-09-21T07:03:22.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:22.853+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f54781a49d0 con 0x7f54680b6590 2024-09-21T07:03:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:03:22.453+0000 7f564eac5640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:03:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:03:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:03:22.465+0000 7f56468bb640 -1 osd.10 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi129 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi129 to 4272M 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='osd.10 ' entity='osd.10' 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:23.235 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:23.236 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:23 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi129 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi129 to 4272M 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='osd.10 ' entity='osd.10' 2024-09-21T07:03:23.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:23.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:23.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:23 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:23.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi129 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi129 to 4272M 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi129", "root=default"]}]': finished 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='osd.10 ' entity='osd.10' 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:23.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:23 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:24.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:03:24.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] boot 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: osdmap e60: 11 total, 11 up, 11 in 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:24 smithi181 ceph-mon[34686]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] boot 2024-09-21T07:03:24.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: osdmap e60: 11 total, 11 up, 11 in 2024-09-21T07:03:24.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:24 smithi028 ceph-mon[31213]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T07:03:24.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: osd.10 [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] boot 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: osdmap e60: 11 total, 11 up, 11 in 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:03:24.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:24 smithi129 ceph-mon[34863]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T07:03:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:03:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/1629995693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"}]': finished 2024-09-21T07:03:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T07:03:25.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:25 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/1629995693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"}]': finished 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T07:03:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:25 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:25.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/1629995693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"} : dispatch 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0442b0e3-81cf-42c5-a98b-00f0f4cd9472"}]': finished 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T07:03:25.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:25 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:26.758 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:26 smithi129 ceph-mon[34863]: from='client.? 172.21.15.181:0/561811530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:26.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:26 smithi181 ceph-mon[34686]: from='client.? 172.21.15.181:0/561811530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:26.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:26 smithi028 ceph-mon[31213]: from='client.? 172.21.15.181:0/561811530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:27 smithi181 ceph-mon[34686]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:27 smithi028 ceph-mon[31213]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:27 smithi129 ceph-mon[34863]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:29.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:29 smithi181 ceph-mon[34686]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:29 smithi028 ceph-mon[31213]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:29 smithi129 ceph-mon[34863]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T07:03:31.605 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:31 smithi181 ceph-mon[34686]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:03:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:31 smithi028 ceph-mon[31213]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:03:31.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:31 smithi129 ceph-mon[34863]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.667 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:33 smithi181 ceph-mon[34686]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:33 smithi028 ceph-mon[31213]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:33 smithi129 ceph-mon[34863]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:03:34.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:03:34.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:34.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:34 smithi181 ceph-mon[34686]: Deploying daemon osd.11 on smithi181 2024-09-21T07:03:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:03:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:34.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:34 smithi028 ceph-mon[31213]: Deploying daemon osd.11 on smithi181 2024-09-21T07:03:34.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:03:34.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:34.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:34 smithi129 ceph-mon[34863]: Deploying daemon osd.11 on smithi181 2024-09-21T07:03:35.704 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:35 smithi181 ceph-mon[34686]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:03:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:35 smithi028 ceph-mon[31213]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:03:35.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:35 smithi129 ceph-mon[34863]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:03:37.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:37 smithi181 ceph-mon[34686]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:03:37.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:37 smithi028 ceph-mon[31213]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:03:37.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:37 smithi129 ceph-mon[34863]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:03:39.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:39 smithi181 ceph-mon[34686]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:39.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:39 smithi028 ceph-mon[31213]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:39.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:39 smithi129 ceph-mon[34863]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:40.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:40 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:40.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:40 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:40.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:40.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:40 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:42.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:41 smithi028 ceph-mon[31213]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:42.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:41 smithi181 ceph-mon[34686]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:42.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:41 smithi129 ceph-mon[34863]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:43.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.323+0000 7f5475ffb640 1 -- 172.21.15.181:0/1940964792 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f54781a49d0 con 0x7f54680b6590 2024-09-21T07:03:43.325 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 msgr2=0x7f54680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 0x7f54680b8aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5464006010 tx=0x7f54640314a0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 msgr2=0x7f5478104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c920 tx=0x7f546c00cde0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 shutdown_connections 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f54680b6590 0x7f54680b8aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54781083a0 0x7f5478103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5478105780 0x7f5478103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 --2- 172.21.15.181:0/1940964792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5478102d00 0x7f5478104960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 >> 172.21.15.181:0/1940964792 conn(0x7f54780fd760 msgr2=0x7f5478107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:43.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 shutdown_connections 2024-09-21T07:03:43.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:43.325+0000 7f547eba4640 1 -- 172.21.15.181:0/1940964792 wait complete. 2024-09-21T07:03:43.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:43 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.994 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:43.995 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:43 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.022 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T07:03:44.024 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:03:44.025 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:03:44.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:43 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:44.295 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 -- 172.21.15.28:0/803292498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c106990 msgr2=0x7efc3c108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 --2- 172.21.15.28:0/803292498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c106990 0x7efc3c108db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efc28009900 tx=0x7efc2802a410 comp rx=0 tx=0).stop 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 -- 172.21.15.28:0/803292498 shutdown_connections 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 --2- 172.21.15.28:0/803292498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 0x7efc3c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 --2- 172.21.15.28:0/803292498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c106990 0x7efc3c108db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 --2- 172.21.15.28:0/803292498 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c06b8c0 0x7efc3c106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 -- 172.21.15.28:0/803292498 >> 172.21.15.28:0/803292498 conn(0x7efc3c0fdfb0 msgr2=0x7efc3c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 -- 172.21.15.28:0/803292498 shutdown_connections 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 -- 172.21.15.28:0/803292498 wait complete. 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.798+0000 7efc42c52640 1 Processor -- start 2024-09-21T07:03:44.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 -- start start 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 0x7efc3c102350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 0x7efc3c102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c10f380 con 0x7efc3c06b8c0 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c10f200 con 0x7efc3c106990 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc42c52640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c10f500 con 0x7efc3c109470 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34804/0 (socket says 172.21.15.28:34804) 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 -- 172.21.15.28:0/3175926094 learned_addr learned my addr 172.21.15.28:0/3175926094 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc411ef640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 0x7efc3c102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc3bfff640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 0x7efc3c102350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 -- 172.21.15.28:0/3175926094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 msgr2=0x7efc3c102890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 0x7efc3c102890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:44.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 -- 172.21.15.28:0/3175926094 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 msgr2=0x7efc3c102350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 0x7efc3c102350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 -- 172.21.15.28:0/3175926094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c102f90 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc3bfff640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 0x7efc3c102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.799+0000 7efc409ee640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc3000e9f0 tx=0x7efc3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.800+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3000cd80 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.800+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc300108e0 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.800+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c1a4030 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.800+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30018980 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.800+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1a4490 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.801+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c0ffad0 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.803+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efc30010430 con 0x7efc3c06b8c0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.804+0000 7efc39ffb640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 0x7efc2c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.804+0000 7efc3bfff640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 0x7efc2c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:44.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.804+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6809+0+0 (secure 0 0 0) 0x7efc300e7570 con 0x7efc3c06b8c0 2024-09-21T07:03:44.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.804+0000 7efc3bfff640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 0x7efc2c0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc28005f70 tx=0x7efc28000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:44.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.807+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc300ae3e0 con 0x7efc3c06b8c0 2024-09-21T07:03:44.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.997+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7efc3c063fc0 con 0x7efc3c06b8c0 2024-09-21T07:03:44.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:44.997+0000 7efc39ffb640 1 -- 172.21.15.28:0/3175926094 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7efc300b27c0 con 0x7efc3c06b8c0 2024-09-21T07:03:44.999 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 msgr2=0x7efc2c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 0x7efc2c0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc28005f70 tx=0x7efc28000bc0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 msgr2=0x7efc3c103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc3000e9f0 tx=0x7efc3000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 shutdown_connections 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc2c0b6510 0x7efc2c0b8a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc3c109470 0x7efc3c102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc3c106990 0x7efc3c102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 --2- 172.21.15.28:0/3175926094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b8c0 0x7efc3c103a80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:45.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 >> 172.21.15.28:0/3175926094 conn(0x7efc3c0fdfb0 msgr2=0x7efc3c104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:45.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 shutdown_connections 2024-09-21T07:03:45.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:45.000+0000 7efc42c52640 1 -- 172.21.15.28:0/3175926094 wait complete. 2024-09-21T07:03:45.717 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:45 smithi028 ceph-mon[31213]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:45.717 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:45 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3175926094' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:45.746 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902203,"num_in_osds":12,"osd_in_since":1726902205,"num_remapped_pgs":0} 2024-09-21T07:03:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:45 smithi181 ceph-mon[34686]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:45 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3175926094' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:45 smithi129 ceph-mon[34863]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:45 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3175926094' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:46.145 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:03:45 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:03:45.822+0000 7f36b9e21640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:03:46.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:03:46.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:46 smithi181 ceph-mon[34686]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:46.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:46 smithi181 ceph-mon[34686]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:46.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:46 smithi129 ceph-mon[34863]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:46.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:46 smithi129 ceph-mon[34863]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:47.017 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:47.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:46 smithi028 ceph-mon[31213]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:47.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:46 smithi028 ceph-mon[31213]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 -- 172.21.15.28:0/900193693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 msgr2=0x7ff5bc103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 --2- 172.21.15.28:0/900193693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc103ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009900 tx=0x7ff5ac02a480 comp rx=0 tx=0).stop 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 -- 172.21.15.28:0/900193693 shutdown_connections 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 --2- 172.21.15.28:0/900193693 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc104070 0x7ff5bc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 --2- 172.21.15.28:0/900193693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc103ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 --2- 172.21.15.28:0/900193693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc102640 0x7ff5bc102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 -- 172.21.15.28:0/900193693 >> 172.21.15.28:0/900193693 conn(0x7ff5bc0fdfb0 msgr2=0x7ff5bc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 -- 172.21.15.28:0/900193693 shutdown_connections 2024-09-21T07:03:47.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.451+0000 7ff5c3767640 1 -- 172.21.15.28:0/900193693 wait complete. 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 Processor -- start 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 -- start start 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 0x7ff5bc19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 0x7ff5bc19b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e270 con 0x7ff5bc1036d0 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e0f0 con 0x7ff5bc102640 2024-09-21T07:03:47.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.452+0000 7ff5c3767640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e3f0 con 0x7ff5bc104070 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34812/0 (socket says 172.21.15.28:34812) 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 -- 172.21.15.28:0/2465235153 learned_addr learned my addr 172.21.15.28:0/2465235153 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c1503640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 0x7ff5bc19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c1d04640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 0x7ff5bc19b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 -- 172.21.15.28:0/2465235153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 msgr2=0x7ff5bc19b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 0x7ff5bc19b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 -- 172.21.15.28:0/2465235153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 msgr2=0x7ff5bc19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 0x7ff5bc19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 -- 172.21.15.28:0/2465235153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc19b9b0 con 0x7ff5bc1036d0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c1503640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 0x7ff5bc19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c1d04640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 0x7ff5bc19b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c0d02640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac006010 tx=0x7ff5ac004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac03f030 con 0x7ff5bc1036d0 2024-09-21T07:03:47.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc19bc40 con 0x7ff5bc1036d0 2024-09-21T07:03:47.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5ac003cb0 con 0x7ff5bc1036d0 2024-09-21T07:03:47.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac035070 con 0x7ff5bc1036d0 2024-09-21T07:03:47.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.453+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc1a2260 con 0x7ff5bc1036d0 2024-09-21T07:03:47.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.454+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc1a2430 con 0x7ff5bc1036d0 2024-09-21T07:03:47.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.456+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff5ac042030 con 0x7ff5bc1036d0 2024-09-21T07:03:47.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.457+0000 7ff5b27fc640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 0x7ff5a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:47.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.457+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6831+0+0 (secure 0 0 0) 0x7ff5ac107b00 con 0x7ff5bc1036d0 2024-09-21T07:03:47.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.457+0000 7ff5c1503640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 0x7ff5a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:47.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.458+0000 7ff5c1503640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 0x7ff5a80b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800abe0 tx=0x7ff5b800a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:47.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.460+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5ac0ce960 con 0x7ff5bc1036d0 2024-09-21T07:03:47.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.653+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff5bc1a2600 con 0x7ff5bc1036d0 2024-09-21T07:03:47.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.653+0000 7ff5b27fc640 1 -- 172.21.15.28:0/2465235153 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7ff5ac003e60 con 0x7ff5bc1036d0 2024-09-21T07:03:47.656 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 msgr2=0x7ff5a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 0x7ff5a80b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800abe0 tx=0x7ff5b800a5c0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 msgr2=0x7ff5bc19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac006010 tx=0x7ff5ac004340 comp rx=0 tx=0).stop 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 shutdown_connections 2024-09-21T07:03:47.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff5a80b6510 0x7ff5a80b8a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5bc104070 0x7ff5bc19b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5bc1036d0 0x7ff5bc19a680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 --2- 172.21.15.28:0/2465235153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5bc102640 0x7ff5bc19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 >> 172.21.15.28:0/2465235153 conn(0x7ff5bc0fdfb0 msgr2=0x7ff5bc0ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 shutdown_connections 2024-09-21T07:03:47.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:47.656+0000 7ff5c3767640 1 -- 172.21.15.28:0/2465235153 wait complete. 2024-09-21T07:03:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:03:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:03:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: Detected new or changed devices on smithi181 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:47.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:47 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: Detected new or changed devices on smithi181 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:47.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:47.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:47 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:48.014 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T07:03:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: Detected new or changed devices on smithi181 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:48.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:47 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:48.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:03:48.011+0000 7f36b5da3640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:03:48.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:03:48.024+0000 7f36adb99640 -1 osd.11 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:03:48.415 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902203,"num_in_osds":12,"osd_in_since":1726902205,"num_remapped_pgs":0} 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2465235153' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:48.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:48 smithi129 ceph-mon[34863]: from='osd.11 ' entity='osd.11' 2024-09-21T07:03:49.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:03:49.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:03:49.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2465235153' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:49.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:48 smithi181 ceph-mon[34686]: from='osd.11 ' entity='osd.11' 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2465235153' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:49.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:48 smithi028 ceph-mon[31213]: from='osd.11 ' entity='osd.11' 2024-09-21T07:03:49.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:03:49.688 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: purged_snaps scrub starts 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: purged_snaps scrub ok 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] boot 2024-09-21T07:03:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: osdmap e66: 12 total, 12 up, 12 in 2024-09-21T07:03:49.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: purged_snaps scrub starts 2024-09-21T07:03:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: purged_snaps scrub ok 2024-09-21T07:03:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] boot 2024-09-21T07:03:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: osdmap e66: 12 total, 12 up, 12 in 2024-09-21T07:03:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: purged_snaps scrub starts 2024-09-21T07:03:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: purged_snaps scrub ok 2024-09-21T07:03:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:03:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: osd.11 [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] boot 2024-09-21T07:03:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: osdmap e66: 12 total, 12 up, 12 in 2024-09-21T07:03:50.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:03:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 -- 172.21.15.28:0/574994689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 msgr2=0x7f112c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 --2- 172.21.15.28:0/574994689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c10bb20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1124009ca0 tx=0x7f112402a950 comp rx=0 tx=0).stop 2024-09-21T07:03:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 -- 172.21.15.28:0/574994689 shutdown_connections 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 --2- 172.21.15.28:0/574994689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c10bb20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 --2- 172.21.15.28:0/574994689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 0x7f112c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 --2- 172.21.15.28:0/574994689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 0x7f112c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 -- 172.21.15.28:0/574994689 >> 172.21.15.28:0/574994689 conn(0x7f112c0ff0c0 msgr2=0x7f112c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 -- 172.21.15.28:0/574994689 shutdown_connections 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.152+0000 7f1132441640 1 -- 172.21.15.28:0/574994689 wait complete. 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 Processor -- start 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 -- start start 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 0x7f112c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 0x7f112c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f112c10f3a0 con 0x7f112c105180 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f112c10f220 con 0x7f112c1047e0 2024-09-21T07:03:50.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f1132441640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f112c10f520 con 0x7f112c103750 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f11309de640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f11309de640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34820/0 (socket says 172.21.15.28:34820) 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f11309de640 1 -- 172.21.15.28:0/3144455768 learned_addr learned my addr 172.21.15.28:0/3144455768 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f112b7fe640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 0x7f112c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.153+0000 7f112bfff640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 0x7f112c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 -- 172.21.15.28:0/3144455768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 msgr2=0x7f112c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 0x7f112c199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 -- 172.21.15.28:0/3144455768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 msgr2=0x7f112c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 0x7f112c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 -- 172.21.15.28:0/3144455768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c19b930 con 0x7f112c105180 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11309de640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1124006010 tx=0x7f112402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124034040 con 0x7f112c105180 2024-09-21T07:03:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c19bbc0 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11240308f0 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124039450 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.154+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c1a21e0 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.155+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112c10a930 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.157+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1124037020 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.158+0000 7f11297fa640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.158+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7127+0+0 (secure 0 0 0) 0x7f1124107fb0 con 0x7f112c105180 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.158+0000 7f112bfff640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.158+0000 7f112bfff640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 0x7f11140b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f111c005fd0 tx=0x7f111c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.161+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11240cece0 con 0x7f112c105180 2024-09-21T07:03:50.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.352+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f112c02e810 con 0x7f112c105180 2024-09-21T07:03:50.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.353+0000 7f11297fa640 1 -- 172.21.15.28:0/3144455768 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f1124030ac0 con 0x7f112c105180 2024-09-21T07:03:50.355 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 msgr2=0x7f11140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 0x7f11140b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f111c005fd0 tx=0x7f111c00b390 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 msgr2=0x7f112c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1124006010 tx=0x7f112402fc00 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 shutdown_connections 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f112c105180 0x7f112c19b1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f112c1047e0 0x7f112c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 --2- 172.21.15.28:0/3144455768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f112c103750 0x7f112c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 >> 172.21.15.28:0/3144455768 conn(0x7f112c0ff0c0 msgr2=0x7f112c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.355+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 shutdown_connections 2024-09-21T07:03:50.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:50.356+0000 7f1132441640 1 -- 172.21.15.28:0/3144455768 wait complete. 2024-09-21T07:03:50.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:50 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3144455768' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:50.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:50 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3144455768' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:51.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:50 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3144455768' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:03:51.125 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":66,"num_osds":12,"num_up_osds":12,"osd_up_since":1726902229,"num_in_osds":12,"osd_in_since":1726902205,"num_remapped_pgs":0} 2024-09-21T07:03:51.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:03:51.384 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:51.779 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:51 smithi028 ceph-mon[31213]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:51.779 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:51 smithi028 ceph-mon[31213]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:03:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:51 smithi129 ceph-mon[34863]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:51 smithi129 ceph-mon[34863]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:03:51.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 -- 172.21.15.28:0/2620168087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b8109df0 msgr2=0x7f92b8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:51.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 --2- 172.21.15.28:0/2620168087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b8109df0 0x7f92b8110620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009900 tx=0x7f92b002a410 comp rx=0 tx=0).stop 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 -- 172.21.15.28:0/2620168087 shutdown_connections 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 --2- 172.21.15.28:0/2620168087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b8109df0 0x7f92b8110620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 --2- 172.21.15.28:0/2620168087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b81094a0 0x7f92b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 --2- 172.21.15.28:0/2620168087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 -- 172.21.15.28:0/2620168087 >> 172.21.15.28:0/2620168087 conn(0x7f92b807b850 msgr2=0x7f92b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 -- 172.21.15.28:0/2620168087 shutdown_connections 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 -- 172.21.15.28:0/2620168087 wait complete. 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.869+0000 7f92bda5c640 1 Processor -- start 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 -- start start 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 0x7f92b819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8113ab0 con 0x7f92b81094a0 2024-09-21T07:03:51.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8113930 con 0x7f92b8103b60 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92bda5c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8113c30 con 0x7f92b8109df0 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34838/0 (socket says 172.21.15.28:34838) 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 -- 172.21.15.28:0/582226441 learned_addr learned my addr 172.21.15.28:0/582226441 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b77fe640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 0x7f92b819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b6ffd640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 -- 172.21.15.28:0/582226441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 msgr2=0x7f92b819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 0x7f92b819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 -- 172.21.15.28:0/582226441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 msgr2=0x7f92b819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 -- 172.21.15.28:0/582226441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b81a03d0 con 0x7f92b81094a0 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b6ffd640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:03:51.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b77fe640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 0x7f92b819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.870+0000 7f92b67fc640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00d750 tx=0x7f92ac00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.871+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac017070 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.871+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b81a06c0 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.871+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ac0054d0 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.871+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac004c30 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.871+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b81a6e20 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.872+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b8103f70 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.873+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f92ac004dd0 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.874+0000 7f92bca5a640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 0x7f92a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.874+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f92ac0e6cd0 con 0x7f92b81094a0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.874+0000 7f92b6ffd640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 0x7f92a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:51.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.875+0000 7f92b6ffd640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 0x7f92a00b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005c40 tx=0x7f92a80082f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:51.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:51.878+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92ac0ada00 con 0x7f92b81094a0 2024-09-21T07:03:52.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:51 smithi181 ceph-mon[34686]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:52.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:51 smithi181 ceph-mon[34686]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:03:52.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.068+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92b810bc40 con 0x7f92b81094a0 2024-09-21T07:03:52.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.069+0000 7f92bca5a640 1 -- 172.21.15.28:0/582226441 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+18489 (secure 0 0 0) 0x7f92ac0b1de0 con 0x7f92b81094a0 2024-09-21T07:03:52.071 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:03:52.071 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":67,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:03:50.571942+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:03:52.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 msgr2=0x7f92a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:52.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 0x7f92a00b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005c40 tx=0x7f92a80082f0 comp rx=0 tx=0).stop 2024-09-21T07:03:52.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 msgr2=0x7f92b819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:52.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00d750 tx=0x7f92ac00dc10 comp rx=0 tx=0).stop 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 shutdown_connections 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f92a00b6510 0x7f92a00b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b8109df0 0x7f92b819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b81094a0 0x7f92b819aa00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 --2- 172.21.15.28:0/582226441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b8103b60 0x7f92b819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 >> 172.21.15.28:0/582226441 conn(0x7f92b807b850 msgr2=0x7f92b81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 shutdown_connections 2024-09-21T07:03:52.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:52.071+0000 7f92bda5c640 1 -- 172.21.15.28:0/582226441 wait complete. 2024-09-21T07:03:52.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:52 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/582226441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:03:52.827 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:59:58.659335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:03:52.828 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:03:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:52 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/582226441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:03:53.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:52 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/582226441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:03:53.099 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 -- 172.21.15.28:0/4022248063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 msgr2=0x7f9548110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 --2- 172.21.15.28:0/4022248063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f9548110620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9540009ca0 tx=0x7f954002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 -- 172.21.15.28:0/4022248063 shutdown_connections 2024-09-21T07:03:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 --2- 172.21.15.28:0/4022248063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f9548110620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 --2- 172.21.15.28:0/4022248063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 0x7f95481098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 --2- 172.21.15.28:0/4022248063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 0x7f9548103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 -- 172.21.15.28:0/4022248063 >> 172.21.15.28:0/4022248063 conn(0x7f954807b850 msgr2=0x7f954807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 -- 172.21.15.28:0/4022248063 shutdown_connections 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 -- 172.21.15.28:0/4022248063 wait complete. 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.598+0000 7f954da69640 1 Processor -- start 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 -- start start 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 0x7f954819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 0x7f954819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9548113ab0 con 0x7f9548109df0 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9548113930 con 0x7f95481094a0 2024-09-21T07:03:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f954da69640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9548113c30 con 0x7f9548103b60 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46596/0 (socket says 172.21.15.28:46596) 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 -- 172.21.15.28:0/2223526234 learned_addr learned my addr 172.21.15.28:0/2223526234 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f95477fe640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 0x7f954819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9546ffd640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 0x7f954819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 -- 172.21.15.28:0/2223526234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 msgr2=0x7f954819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 0x7f954819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 -- 172.21.15.28:0/2223526234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 msgr2=0x7f954819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 0x7f954819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.599+0000 7f9547fff640 1 -- 172.21.15.28:0/2223526234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95481a2630 con 0x7f9548109df0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f9547fff640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9540005cc0 tx=0x7f954002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540003bf0 con 0x7f9548109df0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9540003d90 con 0x7f9548109df0 2024-09-21T07:03:53.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95481a28c0 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954002fbc0 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.600+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95481a9080 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.601+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9548103f70 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.603+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f954002fd60 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.603+0000 7f9544ff9640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 0x7f95300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.604+0000 7f95477fe640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 0x7f95300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.604+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f9540108580 con 0x7f9548109df0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.604+0000 7f95477fe640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 0x7f95300b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9538005fd0 tx=0x7f9538005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.607+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95400cf2b0 con 0x7f9548109df0 2024-09-21T07:03:53.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.793+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95481a92b0 con 0x7f9548109df0 2024-09-21T07:03:53.795 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:53 smithi028 ceph-mon[31213]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:53.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.793+0000 7f9544ff9640 1 -- 172.21.15.28:0/2223526234 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f95400098b0 con 0x7f9548109df0 2024-09-21T07:03:53.796 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 msgr2=0x7f95300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 0x7f95300b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9538005fd0 tx=0x7f9538005850 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 msgr2=0x7f95481a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9540005cc0 tx=0x7f954002f380 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 shutdown_connections 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f95300b6510 0x7f95300b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9548109df0 0x7f95481a1f00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f95481094a0 0x7f954819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 --2- 172.21.15.28:0/2223526234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103b60 0x7f954819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.796+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 >> 172.21.15.28:0/2223526234 conn(0x7f954807b850 msgr2=0x7f9548105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.797+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 shutdown_connections 2024-09-21T07:03:53.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:53.797+0000 7f954da69640 1 -- 172.21.15.28:0/2223526234 wait complete. 2024-09-21T07:03:53.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:53 smithi129 ceph-mon[34863]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:54.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:53 smithi181 ceph-mon[34686]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.a on smithi028 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.d on smithi028 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.g on smithi028 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.j on smithi028 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.b on smithi129 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.e on smithi129 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.h on smithi129 2024-09-21T07:03:54.538 INFO:tasks.cephadm:Adding mds.k on smithi129 2024-09-21T07:03:54.539 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-09-21T07:03:54.539 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-09-21T07:03:54.539 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-09-21T07:03:54.539 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-09-21T07:03:54.539 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-09-21T07:03:54.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:54 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2223526234' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:03:54.800 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:54.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:54 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2223526234' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:03:54.920 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:54 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2223526234' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 -- 172.21.15.181:0/1253627512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 msgr2=0x7ff37810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/1253627512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff37810aa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff370009ca0 tx=0x7ff37002a950 comp rx=0 tx=0).stop 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 -- 172.21.15.181:0/1253627512 shutdown_connections 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/1253627512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff37810aa10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/1253627512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff378103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/1253627512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff378102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 -- 172.21.15.181:0/1253627512 >> 172.21.15.181:0/1253627512 conn(0x7ff3780fdfb0 msgr2=0x7ff378100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 -- 172.21.15.181:0/1253627512 shutdown_connections 2024-09-21T07:03:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 -- 172.21.15.181:0/1253627512 wait complete. 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.300+0000 7ff37c9e4640 1 Processor -- start 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 -- start start 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff37806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff37819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810e290 con 0x7ff3781036d0 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810e110 con 0x7ff378102640 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37c9e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810e410 con 0x7ff378104070 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff376d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:53550/0 (socket says 172.21.15.181:53550) 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff37806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff376d9d640 1 -- 172.21.15.181:0/3352790343 learned_addr learned my addr 172.21.15.181:0/3352790343 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff36ffff640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff37819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 -- 172.21.15.181:0/3352790343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 msgr2=0x7ff3781a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 -- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 msgr2=0x7ff37819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff37819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff37659c640 1 -- 172.21.15.181:0/3352790343 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3781a1a60 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff376d9d640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.301+0000 7ff36ffff640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff37819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff37659c640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff37806b6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e9f0 tx=0x7ff36800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36800ccc0 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3781a1d50 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff368005020 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368004a00 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.302+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3781a2180 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.303+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff378109820 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.305+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff368004ba0 con 0x7ff378102640 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.305+0000 7ff36f7fe640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 0x7ff3640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.306+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7ff3680e6fe0 con 0x7ff378102640 2024-09-21T07:03:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.306+0000 7ff36ffff640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 0x7ff3640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.306+0000 7ff36ffff640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 0x7ff3640b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff360009c20 tx=0x7ff360005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.309+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3680add20 con 0x7ff378102640 2024-09-21T07:03:55.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.505+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) -- 0x7ff378063900 con 0x7ff3640b6510 2024-09-21T07:03:55.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.514+0000 7ff36f7fe640 1 -- 172.21.15.181:0/3352790343 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7ff378063900 con 0x7ff3640b6510 2024-09-21T07:03:55.516 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 msgr2=0x7ff3640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 0x7ff3640b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff360009c20 tx=0x7ff360005f90 comp rx=0 tx=0).stop 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 msgr2=0x7ff37806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff37806b6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e9f0 tx=0x7ff36800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 shutdown_connections 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3640b6510 0x7ff3640b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff378104070 0x7ff3781a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3781036d0 0x7ff37819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 --2- 172.21.15.181:0/3352790343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff378102640 0x7ff37806b6a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 >> 172.21.15.181:0/3352790343 conn(0x7ff3780fdfb0 msgr2=0x7ff3781069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 shutdown_connections 2024-09-21T07:03:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T07:03:55.516+0000 7ff37c9e4640 1 -- 172.21.15.181:0/3352790343 wait complete. 2024-09-21T07:03:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:55 smithi181 ceph-mon[34686]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:55 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:55.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:55 smithi028 ceph-mon[31213]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:55.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:55.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:55 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:55.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:55 smithi129 ceph-mon[34863]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:55.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:55.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:55 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:56.199 DEBUG:teuthology.orchestra.run.smithi028:mds.a> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T07:03:56.202 DEBUG:teuthology.orchestra.run.smithi028:mds.d> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T07:03:56.246 DEBUG:teuthology.orchestra.run.smithi028:mds.g> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T07:03:56.289 DEBUG:teuthology.orchestra.run.smithi028:mds.j> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T07:03:56.332 DEBUG:teuthology.orchestra.run.smithi129:mds.b> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T07:03:56.334 DEBUG:teuthology.orchestra.run.smithi129:mds.e> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T07:03:56.377 DEBUG:teuthology.orchestra.run.smithi129:mds.h> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T07:03:56.420 DEBUG:teuthology.orchestra.run.smithi129:mds.k> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T07:03:56.464 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T07:03:56.467 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T07:03:56.509 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T07:03:56.552 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T07:03:56.595 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:03:56.595 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:03:56.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:56.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:56 smithi129 ceph-mon[34863]: Deploying daemon mds.l on smithi181 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:56.618 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:56.619 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.619 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:56 smithi028 ceph-mon[31213]: Deploying daemon mds.l on smithi181 2024-09-21T07:03:56.848 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:57.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:57.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T07:03:57.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:57.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:56 smithi181 ceph-mon[34686]: Deploying daemon mds.l on smithi181 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 -- 172.21.15.28:0/261683470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 msgr2=0x7fa1d0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/261683470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d0110620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009ca0 tx=0x7fa1c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 -- 172.21.15.28:0/261683470 shutdown_connections 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/261683470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d0110620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/261683470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/261683470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 0x7fa1d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 -- 172.21.15.28:0/261683470 >> 172.21.15.28:0/261683470 conn(0x7fa1d007b850 msgr2=0x7fa1d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:57.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 -- 172.21.15.28:0/261683470 shutdown_connections 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.295+0000 7fa1d63fd640 1 -- 172.21.15.28:0/261683470 wait complete. 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.296+0000 7fa1d63fd640 1 Processor -- start 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.296+0000 7fa1d63fd640 1 -- start start 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 0x7fa1d019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0113ab0 con 0x7fa1d0109df0 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0113930 con 0x7fa1d01094a0 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d63fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0113c30 con 0x7fa1d0103b60 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46614/0 (socket says 172.21.15.28:46614) 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 -- 172.21.15.28:0/2840682331 learned_addr learned my addr 172.21.15.28:0/2840682331 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1cffff640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 0x7fa1d019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:57.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1cf7fe640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 -- 172.21.15.28:0/2840682331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 msgr2=0x7fa1d019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 0x7fa1d019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 -- 172.21.15.28:0/2840682331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 msgr2=0x7fa1d019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 -- 172.21.15.28:0/2840682331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d01a03f0 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1cf7fe640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.297+0000 7fa1d499a640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005cc0 tx=0x7fa1c802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.298+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8003bf0 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.298+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1c8003d90 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.298+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d01a0680 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.298+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c802fbc0 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.298+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d01a6e40 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.299+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0103f70 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.300+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa1c802fd60 con 0x7fa1d0109df0 2024-09-21T07:03:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.301+0000 7fa1cd7fa640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 0x7fa1b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:57.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.301+0000 7fa1cffff640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 0x7fa1b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:57.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.301+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fa1c81084a0 con 0x7fa1d0109df0 2024-09-21T07:03:57.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.302+0000 7fa1cffff640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 0x7fa1b80b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0005fd0 tx=0x7fa1c000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:57.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.305+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1c80cf1d0 con 0x7fa1d0109df0 2024-09-21T07:03:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.533+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d019b5b0 con 0x7fa1d0109df0 2024-09-21T07:03:57.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.533+0000 7fa1cd7fa640 1 -- 172.21.15.28:0/2840682331 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa1d019b5b0 con 0x7fa1d0109df0 2024-09-21T07:03:57.536 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:03:57.536 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":1,"btime":"2024-09-21T06:56:23:464631+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:03:57.536 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 1 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.535+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 msgr2=0x7fa1b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 0x7fa1b80b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0005fd0 tx=0x7fa1c000b390 comp rx=0 tx=0).stop 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 msgr2=0x7fa1d019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005cc0 tx=0x7fa1c802f380 comp rx=0 tx=0).stop 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 shutdown_connections 2024-09-21T07:03:57.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa1b80b6510 0x7fa1b80b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0109df0 0x7fa1d019fcc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1d01094a0 0x7fa1d019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 --2- 172.21.15.28:0/2840682331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1d0103b60 0x7fa1d019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 >> 172.21.15.28:0/2840682331 conn(0x7fa1d007b850 msgr2=0x7fa1d0105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 shutdown_connections 2024-09-21T07:03:57.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:03:57.536+0000 7fa1d63fd640 1 -- 172.21.15.28:0/2840682331 wait complete. 2024-09-21T07:03:58.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:57 smithi181 ceph-mon[34686]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:58.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:57 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2840682331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:03:58.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:57 smithi028 ceph-mon[31213]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:58.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:57 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2840682331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:03:58.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:57 smithi129 ceph-mon[34863]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:58.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:57 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2840682331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:03:58.769 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:03:58 smithi181 systemd[1]: Started Ceph mds.l for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6832/2982677704,v1:172.21.15.181:6833/2982677704] up:boot 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: fsmap 1 up:standby 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:03:59 smithi129 ceph-mon[34863]: Deploying daemon mds.k on smithi129 2024-09-21T07:03:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6832/2982677704,v1:172.21.15.181:6833/2982677704] up:boot 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: fsmap 1 up:standby 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:03:59 smithi181 ceph-mon[34686]: Deploying daemon mds.k on smithi129 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6832/2982677704,v1:172.21.15.181:6833/2982677704] up:boot 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: fsmap 1 up:standby 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:03:59.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:03:59.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:03:59.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.799 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:03:59 smithi028 ceph-mon[31213]: Deploying daemon mds.k on smithi129 2024-09-21T07:04:00.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:00.588 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:00.607 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 systemd[1]: Starting Ceph mds.k for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:00.883 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 podman[62797]: 2024-09-21 07:04:00.509040173 +0000 UTC m=+0.016136275 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:00.883 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 podman[62797]: 2024-09-21 07:04:00.617112153 +0000 UTC m=+0.124208287 container create 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 -- 172.21.15.28:0/3313088422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c1094b0 msgr2=0x7f160c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 --2- 172.21.15.28:0/3313088422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c1094b0 0x7f160c1098c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1600009900 tx=0x7f160002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 -- 172.21.15.28:0/3313088422 shutdown_connections 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 --2- 172.21.15.28:0/3313088422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c109e00 0x7f160c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 --2- 172.21.15.28:0/3313088422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c1094b0 0x7f160c1098c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 --2- 172.21.15.28:0/3313088422 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c103b70 0x7f160c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 -- 172.21.15.28:0/3313088422 >> 172.21.15.28:0/3313088422 conn(0x7f160c0ff5e0 msgr2=0x7f160c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 -- 172.21.15.28:0/3313088422 shutdown_connections 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.066+0000 7f1612502640 1 -- 172.21.15.28:0/3313088422 wait complete. 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 Processor -- start 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 -- start start 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c1094b0 0x7f160c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c109e00 0x7f160c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:01.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f160c113ac0 con 0x7f160c103b70 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f160c113940 con 0x7f160c109e00 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f1612502640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f160c113c40 con 0x7f160c1094b0 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f160bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f160bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46636/0 (socket says 172.21.15.28:46636) 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.067+0000 7f160bfff640 1 -- 172.21.15.28:0/21240747 learned_addr learned my addr 172.21.15.28:0/21240747 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f1610a9f640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c109e00 0x7f160c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160b7fe640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c1094b0 0x7f160c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 -- 172.21.15.28:0/21240747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c1094b0 msgr2=0x7f160c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:01.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c1094b0 0x7f160c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 -- 172.21.15.28:0/21240747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c109e00 msgr2=0x7f160c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c109e00 0x7f160c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 -- 172.21.15.28:0/21240747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c1a8750 con 0x7f160c103b70 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f160bfff640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9f0 tx=0x7f15fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00cd80 con 0x7f160c103b70 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c1a8a40 con 0x7f160c103b70 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15fc0108e0 con 0x7f160c103b70 2024-09-21T07:04:01.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc018980 con 0x7f160c103b70 2024-09-21T07:04:01.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.068+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1a8f50 con 0x7f160c103b70 2024-09-21T07:04:01.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.069+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c104df0 con 0x7f160c103b70 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.071+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f15fc010430 con 0x7f160c103b70 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.072+0000 7f16097fa640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 0x7f15f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.072+0000 7f160b7fe640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 0x7f15f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.072+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f15fc0e75e0 con 0x7f160c103b70 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.073+0000 7f160b7fe640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 0x7f15f40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1600009230 tx=0x7f1600031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:01.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.075+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15fc0b26f0 con 0x7f160c103b70 2024-09-21T07:04:01.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.306+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f160c103f80 con 0x7f160c103b70 2024-09-21T07:04:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.306+0000 7f16097fa640 1 -- 172.21.15.28:0/21240747 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f15fc0b7630 con 0x7f160c103b70 2024-09-21T07:04:01.309 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:01.309 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"btime":"2024-09-21T07:03:58:405071+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:04:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2024-09-21T07:04:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 msgr2=0x7f15f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 0x7f15f40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1600009230 tx=0x7f1600031400 comp rx=0 tx=0).stop 2024-09-21T07:04:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 msgr2=0x7f160c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9f0 tx=0x7f15fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 shutdown_connections 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f15f40b6510 0x7f15f40b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f160c109e00 0x7f160c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f160c1094b0 0x7f160c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 --2- 172.21.15.28:0/21240747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f160c103b70 0x7f160c075710 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 >> 172.21.15.28:0/21240747 conn(0x7f160c0ff5e0 msgr2=0x7f160c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 shutdown_connections 2024-09-21T07:04:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:01.309+0000 7f1612502640 1 -- 172.21.15.28:0/21240747 wait complete. 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 podman[62797]: 2024-09-21 07:04:00.8822889 +0000 UTC m=+0.389384997 container init 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 podman[62797]: 2024-09-21 07:04:00.885485362 +0000 UTC m=+0.392581468 container start 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 ceph-mds[62816]: -- 172.21.15.129:0/440331199 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564151dc9860 con 0x564155f71a80 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k[62812]: starting mds.k at 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 bash[62797]: 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 2024-09-21T07:04:01.357 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:04:00 smithi129 systemd[1]: Started Ceph mds.k for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:01.626 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:01.626 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.626 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.626 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.626 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:01.627 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:01.627 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:01.627 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:01 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/21240747' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:01.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:01 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/21240747' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:01 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/21240747' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:02.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:02 smithi129 ceph-mon[34863]: Deploying daemon mds.j on smithi028 2024-09-21T07:04:02.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:02 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6832/4256209134,v1:172.21.15.129:6833/4256209134] up:boot 2024-09-21T07:04:02.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:02 smithi129 ceph-mon[34863]: fsmap 2 up:standby 2024-09-21T07:04:02.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:02 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:04:02.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:02 smithi181 ceph-mon[34686]: Deploying daemon mds.j on smithi028 2024-09-21T07:04:02.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:02 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6832/4256209134,v1:172.21.15.129:6833/4256209134] up:boot 2024-09-21T07:04:02.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:02 smithi181 ceph-mon[34686]: fsmap 2 up:standby 2024-09-21T07:04:02.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:02 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:04:02.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:02 smithi028 ceph-mon[31213]: Deploying daemon mds.j on smithi028 2024-09-21T07:04:02.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:02 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6832/4256209134,v1:172.21.15.129:6833/4256209134] up:boot 2024-09-21T07:04:02.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:02 smithi028 ceph-mon[31213]: fsmap 2 up:standby 2024-09-21T07:04:02.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:02 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:04:03.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:03 smithi028 ceph-mon[31213]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:03.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:03 smithi129 ceph-mon[34863]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:03 smithi181 ceph-mon[34686]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:03.798 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:03 smithi028 systemd[1]: Starting Ceph mds.j for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:04.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:04.208 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:03 smithi028 podman[70957]: 2024-09-21 07:04:03.83129013 +0000 UTC m=+0.017131808 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:04.208 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:03 smithi028 podman[70957]: 2024-09-21 07:04:03.953887325 +0000 UTC m=+0.139729000 container create d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T07:04:04.208 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 podman[70957]: 2024-09-21 07:04:04.206675905 +0000 UTC m=+0.392517582 container init d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:04:04.375 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:04.498 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 podman[70957]: 2024-09-21 07:04:04.210152012 +0000 UTC m=+0.395993681 container start d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T07:04:04.498 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 ceph-mds[71001]: -- 172.21.15.28:0/3932871842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649b1bdd860 con 0x5649b5d85a80 2024-09-21T07:04:04.499 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j[70990]: starting mds.j at 2024-09-21T07:04:04.499 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 bash[70957]: d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a 2024-09-21T07:04:04.499 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:04:04 smithi028 systemd[1]: Started Ceph mds.j for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 -- 172.21.15.28:0/4053983533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 msgr2=0x7f84a8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 --2- 172.21.15.28:0/4053983533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a8103f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009900 tx=0x7f84a402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 -- 172.21.15.28:0/4053983533 shutdown_connections 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 --2- 172.21.15.28:0/4053983533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 --2- 172.21.15.28:0/4053983533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 --2- 172.21.15.28:0/4053983533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a8103f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 -- 172.21.15.28:0/4053983533 >> 172.21.15.28:0/4053983533 conn(0x7f84a807b850 msgr2=0x7f84a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 -- 172.21.15.28:0/4053983533 shutdown_connections 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.894+0000 7f84b05b0640 1 -- 172.21.15.28:0/4053983533 wait complete. 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 Processor -- start 2024-09-21T07:04:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 -- start start 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84a8113ab0 con 0x7f84a8103b60 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f84a8113930 con 0x7f84a8109df0 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84b05b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84a8113c30 con 0x7f84a81094a0 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51470/0 (socket says 172.21.15.28:51470) 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 -- 172.21.15.28:0/1860922915 learned_addr learned my addr 172.21.15.28:0/1860922915 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84aeb4d640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84adb4b640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 -- 172.21.15.28:0/1860922915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 msgr2=0x7f84a819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 -- 172.21.15.28:0/1860922915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 msgr2=0x7f84a819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84ae34c640 1 -- 172.21.15.28:0/1860922915 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a81a0310 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84adb4b640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.895+0000 7f84aeb4d640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f84ae34c640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005940 tx=0x7f84a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a403f030 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84a4003cb0 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4035070 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a81a05a0 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.896+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a81a0a30 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.897+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8103f70 con 0x7f84a8103b60 2024-09-21T07:04:04.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.899+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f84a4042030 con 0x7f84a8103b60 2024-09-21T07:04:04.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.899+0000 7f849f7fe640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 0x7f84940b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:04.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.899+0000 7f84adb4b640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 0x7f84940b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:04.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.900+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f84a4107620 con 0x7f84a8103b60 2024-09-21T07:04:04.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.900+0000 7f84adb4b640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 0x7f84940b8a50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84a8109200 tx=0x7f849800a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:04.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:04.903+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84a40ce350 con 0x7f84a8103b60 2024-09-21T07:04:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.142+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84a802e640 con 0x7f84a8103b60 2024-09-21T07:04:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.142+0000 7f849f7fe640 1 -- 172.21.15.28:0/1860922915 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f84a40d2730 con 0x7f84a8103b60 2024-09-21T07:04:05.145 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:05.145 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":4,"btime":"2024-09-21T07:04:04:423557+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:04:05.145 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 4 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.144+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 msgr2=0x7f84940b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.144+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 0x7f84940b8a50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84a8109200 tx=0x7f849800a5c0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.144+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 msgr2=0x7f84a819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.144+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005940 tx=0x7f84a40042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 shutdown_connections 2024-09-21T07:04:05.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f84940b6540 0x7f84940b8a50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84a8109df0 0x7f84a819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84a81094a0 0x7f84a819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 --2- 172.21.15.28:0/1860922915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84a8103b60 0x7f84a819a460 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 >> 172.21.15.28:0/1860922915 conn(0x7f84a807b850 msgr2=0x7f84a8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 shutdown_connections 2024-09-21T07:04:05.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:05.145+0000 7f84b05b0640 1 -- 172.21.15.28:0/1860922915 wait complete. 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: Deploying daemon mds.d on smithi028 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6834/2354310763,v1:172.21.15.28:6835/2354310763] up:boot 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: fsmap 3 up:standby 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:04:05.671 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1860922915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: Deploying daemon mds.d on smithi028 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6834/2354310763,v1:172.21.15.28:6835/2354310763] up:boot 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: fsmap 3 up:standby 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:04:05.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:05 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1860922915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:05.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: Deploying daemon mds.d on smithi028 2024-09-21T07:04:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6834/2354310763,v1:172.21.15.28:6835/2354310763] up:boot 2024-09-21T07:04:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: fsmap 3 up:standby 2024-09-21T07:04:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:04:05.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:05 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1860922915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:07.725 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:07 smithi181 ceph-mon[34686]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:07.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:07 smithi028 ceph-mon[31213]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:07.798 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:07 smithi028 systemd[1]: Starting Ceph mds.d for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:07 smithi129 ceph-mon[34863]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:08.074 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:07 smithi028 podman[71347]: 2024-09-21 07:04:07.725194408 +0000 UTC m=+0.016529655 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:08.074 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:07 smithi028 podman[71347]: 2024-09-21 07:04:07.85055125 +0000 UTC m=+0.141886487 container create b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T07:04:08.074 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 podman[71347]: 2024-09-21 07:04:08.069934507 +0000 UTC m=+0.361269748 container init b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T07:04:08.074 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 podman[71347]: 2024-09-21 07:04:08.073107848 +0000 UTC m=+0.364443091 container start b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:04:08.131 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:08.401 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:08.523 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 ceph-mds[71366]: -- 172.21.15.28:0/194340002 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625f3a25860 con 0x5625f7bcd600 2024-09-21T07:04:08.523 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d[71362]: starting mds.d at 2024-09-21T07:04:08.523 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 bash[71347]: b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf 2024-09-21T07:04:08.523 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:04:08 smithi028 systemd[1]: Started Ceph mds.d for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:08.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.908+0000 7f726ddbc640 1 -- 172.21.15.28:0/1348419181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 msgr2=0x7f726810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:08.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.908+0000 7f726ddbc640 1 --2- 172.21.15.28:0/1348419181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726810f520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7260009ca0 tx=0x7f726002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 -- 172.21.15.28:0/1348419181 shutdown_connections 2024-09-21T07:04:08.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 --2- 172.21.15.28:0/1348419181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726810f520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 --2- 172.21.15.28:0/1348419181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72681083a0 0x7f72681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 --2- 172.21.15.28:0/1348419181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7268102a60 0x7f7268102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 -- 172.21.15.28:0/1348419181 >> 172.21.15.28:0/1348419181 conn(0x7f7268079730 msgr2=0x7f7268079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 -- 172.21.15.28:0/1348419181 shutdown_connections 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 -- 172.21.15.28:0/1348419181 wait complete. 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.909+0000 7f726ddbc640 1 Processor -- start 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 -- start start 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7268102a60 0x7f726819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f72681083a0 0x7f726819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7268113ae0 con 0x7f7268108cf0 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7268113960 con 0x7f72681083a0 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f726ddbc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7268113c60 con 0x7f7268102a60 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51512/0 (socket says 172.21.15.28:51512) 2024-09-21T07:04:08.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 -- 172.21.15.28:0/338045298 learned_addr learned my addr 172.21.15.28:0/338045298 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f72677fe640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7268102a60 0x7f726819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7266ffd640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f72681083a0 0x7f726819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 -- 172.21.15.28:0/338045298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7268102a60 msgr2=0x7f726819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7268102a60 0x7f726819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 -- 172.21.15.28:0/338045298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f72681083a0 msgr2=0x7f726819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f72681083a0 0x7f726819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.910+0000 7f7267fff640 1 -- 172.21.15.28:0/338045298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72681a04a0 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f7267fff640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7260005cc0 tx=0x7f726002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260003bf0 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72681a0730 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7260003d90 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726002fb20 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.911+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72681a6ef0 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.912+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7268102e70 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.913+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7260004580 con 0x7f7268108cf0 2024-09-21T07:04:08.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.914+0000 7f7264ff9640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 0x7f72500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:08.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.915+0000 7f72677fe640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 0x7f72500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:08.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.915+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f7260108300 con 0x7f7268108cf0 2024-09-21T07:04:08.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.915+0000 7f72677fe640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 0x7f72500b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7258009990 tx=0x7f7258009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:08.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:08.918+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72600cef90 con 0x7f7268108cf0 2024-09-21T07:04:09.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.143+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f726819b660 con 0x7f7268108cf0 2024-09-21T07:04:09.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.143+0000 7f7264ff9640 1 -- 172.21.15.28:0/338045298 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f726819b660 con 0x7f7268108cf0 2024-09-21T07:04:09.146 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:09.146 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"btime":"2024-09-21T07:04:08:360383+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:04:09.146 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 5 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 msgr2=0x7f72500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 0x7f72500b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7258009990 tx=0x7f7258009110 comp rx=0 tx=0).stop 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 msgr2=0x7f726819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7260005cc0 tx=0x7f726002f380 comp rx=0 tx=0).stop 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 shutdown_connections 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f72500b6590 0x7f72500b8aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7268108cf0 0x7f726819fd70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f72681083a0 0x7f726819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 --2- 172.21.15.28:0/338045298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7268102a60 0x7f726819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 >> 172.21.15.28:0/338045298 conn(0x7f7268079730 msgr2=0x7f72681052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:09.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 shutdown_connections 2024-09-21T07:04:09.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:09.146+0000 7f726ddbc640 1 -- 172.21.15.28:0/338045298 wait complete. 2024-09-21T07:04:09.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: Deploying daemon mds.e on smithi129 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6836/2155481344,v1:172.21.15.28:6837/2155481344] up:boot 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: fsmap 4 up:standby 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:04:09.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:09 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/338045298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: Deploying daemon mds.e on smithi129 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6836/2155481344,v1:172.21.15.28:6837/2155481344] up:boot 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: fsmap 4 up:standby 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:04:09.538 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:09 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/338045298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: Deploying daemon mds.e on smithi129 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6836/2155481344,v1:172.21.15.28:6837/2155481344] up:boot 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: fsmap 4 up:standby 2024-09-21T07:04:09.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:04:09.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:09 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/338045298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:10.505 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 systemd[1]: Starting Ceph mds.e for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:10.776 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 podman[63078]: 2024-09-21 07:04:10.406528539 +0000 UTC m=+0.015955200 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:10.776 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 podman[63078]: 2024-09-21 07:04:10.522421442 +0000 UTC m=+0.131848105 container create 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T07:04:10.776 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 podman[63078]: 2024-09-21 07:04:10.774985522 +0000 UTC m=+0.384412195 container init 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:04:11.107 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 podman[63078]: 2024-09-21 07:04:10.777924682 +0000 UTC m=+0.387351343 container start 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T07:04:11.107 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 ceph-mds[63097]: -- 172.21.15.129:0/4135963072 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ac7251860 con 0x559acb3f9180 2024-09-21T07:04:11.107 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e[63093]: starting mds.e at 2024-09-21T07:04:11.107 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 bash[63078]: 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 2024-09-21T07:04:11.107 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:04:10 smithi129 systemd[1]: Started Ceph mds.e for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:11.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:12.157 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: Deploying daemon mds.f on smithi181 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6834/3637531952,v1:172.21.15.129:6835/3637531952] up:boot 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: fsmap 5 up:standby 2024-09-21T07:04:12.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:11 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: Deploying daemon mds.f on smithi181 2024-09-21T07:04:12.278 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6834/3637531952,v1:172.21.15.129:6835/3637531952] up:boot 2024-09-21T07:04:12.279 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: fsmap 5 up:standby 2024-09-21T07:04:12.279 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:11 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: Deploying daemon mds.f on smithi181 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6834/3637531952,v1:172.21.15.129:6835/3637531952] up:boot 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: fsmap 5 up:standby 2024-09-21T07:04:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:11 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:04:12.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 -- 172.21.15.28:0/2803397336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c108d10 msgr2=0x7fee0c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 --2- 172.21.15.28:0/2803397336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c108d10 0x7fee0c10f540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee04009ca0 tx=0x7fee0402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 -- 172.21.15.28:0/2803397336 shutdown_connections 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 --2- 172.21.15.28:0/2803397336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c108d10 0x7fee0c10f540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 --2- 172.21.15.28:0/2803397336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c1083c0 0x7fee0c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 --2- 172.21.15.28:0/2803397336 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 0x7fee0c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 -- 172.21.15.28:0/2803397336 >> 172.21.15.28:0/2803397336 conn(0x7fee0c0796d0 msgr2=0x7fee0c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 -- 172.21.15.28:0/2803397336 shutdown_connections 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.748+0000 7fee13fa0640 1 -- 172.21.15.28:0/2803397336 wait complete. 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 Processor -- start 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 -- start start 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 0x7fee0c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c108d10 0x7fee0c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c1129d0 con 0x7fee0c1083c0 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c112850 con 0x7fee0c102ad0 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee13fa0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c112b50 con 0x7fee0c108d10 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee1153b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee1153b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46018/0 (socket says 172.21.15.28:46018) 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee1153b640 1 -- 172.21.15.28:0/4241061150 learned_addr learned my addr 172.21.15.28:0/4241061150 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee1253d640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c108d10 0x7fee0c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.749+0000 7fee11d3c640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 0x7fee0c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 -- 172.21.15.28:0/4241061150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c108d10 msgr2=0x7fee0c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c108d10 0x7fee0c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 -- 172.21.15.28:0/4241061150 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 msgr2=0x7fee0c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 0x7fee0c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 -- 172.21.15.28:0/4241061150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c1a65a0 con 0x7fee0c1083c0 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee1153b640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00d750 tx=0x7fedfc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc017070 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedfc0054d0 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c1a6890 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc004c30 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.750+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c1a6d80 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.751+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c103d00 con 0x7fee0c1083c0 2024-09-21T07:04:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.753+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fedfc004dd0 con 0x7fee0c1083c0 2024-09-21T07:04:12.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.754+0000 7fee02ffd640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 0x7fedf80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:12.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.754+0000 7fee11d3c640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 0x7fedf80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:12.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.755+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fedfc0e6b40 con 0x7fee0c1083c0 2024-09-21T07:04:12.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.755+0000 7fee11d3c640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 0x7fedf80b8a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06c6c0 tx=0x7fee0800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:12.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.758+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedfc0b1c30 con 0x7fee0c1083c0 2024-09-21T07:04:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.986+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee0c102ee0 con 0x7fee0c1083c0 2024-09-21T07:04:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.986+0000 7fee02ffd640 1 -- 172.21.15.28:0/4241061150 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7fedfc0b6b70 con 0x7fee0c1083c0 2024-09-21T07:04:12.988 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:12.988 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":6,"btime":"2024-09-21T07:04:11:303798+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:04:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 6 2024-09-21T07:04:12.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 msgr2=0x7fedf80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:12.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 0x7fedf80b8a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06c6c0 tx=0x7fee0800b390 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 msgr2=0x7fee0c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00d750 tx=0x7fedfc00dc10 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 shutdown_connections 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fedf80b6510 0x7fedf80b8a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee0c108d10 0x7fee0c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee0c1083c0 0x7fee0c19b820 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 --2- 172.21.15.28:0/4241061150 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee0c102ad0 0x7fee0c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 >> 172.21.15.28:0/4241061150 conn(0x7fee0c0796d0 msgr2=0x7fee0c106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 shutdown_connections 2024-09-21T07:04:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:12.989+0000 7fee13fa0640 1 -- 172.21.15.28:0/4241061150 wait complete. 2024-09-21T07:04:12.994 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:12 smithi181 systemd[1]: Starting Ceph mds.f for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:13.269 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:12 smithi181 podman[62927]: 2024-09-21 07:04:12.895953364 +0000 UTC m=+0.016186379 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:13.269 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 podman[62927]: 2024-09-21 07:04:13.015568227 +0000 UTC m=+0.135801231 container create e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T07:04:13.769 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 podman[62927]: 2024-09-21 07:04:13.288468807 +0000 UTC m=+0.408701807 container init e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T07:04:13.770 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 podman[62927]: 2024-09-21 07:04:13.29120542 +0000 UTC m=+0.411438434 container start e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:04:13.770 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mds[62946]: -- 172.21.15.181:0/1069084064 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf51d15860 con 0x55bf55ebd180 2024-09-21T07:04:13.770 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: starting mds.f at 2024-09-21T07:04:13.770 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 bash[62927]: e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba 2024-09-21T07:04:13.770 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:04:13 smithi181 systemd[1]: Started Ceph mds.f for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4241061150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4241061150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:14.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:14.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4241061150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:14.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:15.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:14 smithi181 ceph-mon[34686]: Deploying daemon mds.c on smithi181 2024-09-21T07:04:15.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:14 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6834/1882677876,v1:172.21.15.181:6835/1882677876] up:boot 2024-09-21T07:04:15.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:14 smithi181 ceph-mon[34686]: fsmap 6 up:standby 2024-09-21T07:04:15.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:14 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:04:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:14 smithi028 ceph-mon[31213]: Deploying daemon mds.c on smithi181 2024-09-21T07:04:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:14 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6834/1882677876,v1:172.21.15.181:6835/1882677876] up:boot 2024-09-21T07:04:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:14 smithi028 ceph-mon[31213]: fsmap 6 up:standby 2024-09-21T07:04:15.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:14 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:04:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:14 smithi129 ceph-mon[34863]: Deploying daemon mds.c on smithi181 2024-09-21T07:04:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:14 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6834/1882677876,v1:172.21.15.181:6835/1882677876] up:boot 2024-09-21T07:04:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:14 smithi129 ceph-mon[34863]: fsmap 6 up:standby 2024-09-21T07:04:15.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:14 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:04:15.519 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 systemd[1]: Starting Ceph mds.c for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:15.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:15.793 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 podman[63198]: 2024-09-21 07:04:15.426413077 +0000 UTC m=+0.015630505 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:15.793 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 podman[63198]: 2024-09-21 07:04:15.547861601 +0000 UTC m=+0.137079027 container create 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:04:15.793 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 podman[63198]: 2024-09-21 07:04:15.792422964 +0000 UTC m=+0.381640382 container init 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T07:04:15.958 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:16.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:15 smithi028 ceph-mon[31213]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:15 smithi181 ceph-mon[34686]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:16.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 podman[63198]: 2024-09-21 07:04:15.795531551 +0000 UTC m=+0.384748970 container start 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:04:16.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 ceph-mds[63218]: -- 172.21.15.181:0/600630156 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55feb5691860 con 0x55feb9839a80 2024-09-21T07:04:16.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: starting mds.c at 2024-09-21T07:04:16.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 bash[63198]: 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 2024-09-21T07:04:16.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:04:15 smithi181 systemd[1]: Started Ceph mds.c for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:15 smithi129 ceph-mon[34863]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.437+0000 7fbd62fc2640 1 -- 172.21.15.28:0/2857219955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 msgr2=0x7fbd5c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.437+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/2857219955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c10d850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009900 tx=0x7fbd4802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 -- 172.21.15.28:0/2857219955 shutdown_connections 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/2857219955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c10de10 0x7fbd5c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/2857219955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c10d850 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/2857219955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c1049b0 0x7fbd5c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 -- 172.21.15.28:0/2857219955 >> 172.21.15.28:0/2857219955 conn(0x7fbd5c079730 msgr2=0x7fbd5c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 -- 172.21.15.28:0/2857219955 shutdown_connections 2024-09-21T07:04:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 -- 172.21.15.28:0/2857219955 wait complete. 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 Processor -- start 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.438+0000 7fbd62fc2640 1 -- start start 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c1049b0 0x7fbd5c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c10de10 0x7fbd5c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c113a70 con 0x7fbd5c105300 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1138f0 con 0x7fbd5c10de10 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd62fc2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c113bf0 con 0x7fbd5c1049b0 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46036/0 (socket says 172.21.15.28:46036) 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 -- 172.21.15.28:0/362157437 learned_addr learned my addr 172.21.15.28:0/362157437 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd60d5e640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c1049b0 0x7fbd5c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd6155f640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c10de10 0x7fbd5c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 -- 172.21.15.28:0/362157437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c1049b0 msgr2=0x7fbd5c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c1049b0 0x7fbd5c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 -- 172.21.15.28:0/362157437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c10de10 msgr2=0x7fbd5c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c10de10 0x7fbd5c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.439+0000 7fbd5bfff640 1 -- 172.21.15.28:0/362157437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c1a0410 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd5bfff640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802a930 tx=0x7fbd48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803f030 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1a06a0 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd48003aa0 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48035070 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.440+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1a6e60 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.441+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5c104dc0 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.444+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbd48042030 con 0x7fbd5c105300 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.445+0000 7fbd59ffb640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.445+0000 7fbd60d5e640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:16.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.445+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fbd48107840 con 0x7fbd5c105300 2024-09-21T07:04:16.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.446+0000 7fbd60d5e640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c06bc60 tx=0x7fbd5000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:16.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.448+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd480d2950 con 0x7fbd5c105300 2024-09-21T07:04:16.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.674+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd5c108f40 con 0x7fbd5c105300 2024-09-21T07:04:16.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.675+0000 7fbd59ffb640 1 -- 172.21.15.28:0/362157437 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7fbd480d7890 con 0x7fbd5c105300 2024-09-21T07:04:16.677 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:16.677 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"btime":"2024-09-21T07:04:15:922806+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T07:04:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2024-09-21T07:04:16.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 msgr2=0x7fbd4c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:16.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c06bc60 tx=0x7fbd5000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 msgr2=0x7fbd5c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802a930 tx=0x7fbd48004270 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 shutdown_connections 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd5c10de10 0x7fbd5c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd5c105300 0x7fbd5c19aa40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 --2- 172.21.15.28:0/362157437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd5c1049b0 0x7fbd5c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 >> 172.21.15.28:0/362157437 conn(0x7fbd5c079730 msgr2=0x7fbd5c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 shutdown_connections 2024-09-21T07:04:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:16.678+0000 7fbd62fc2640 1 -- 172.21.15.28:0/362157437 wait complete. 2024-09-21T07:04:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6836/499879490,v1:172.21.15.181:6837/499879490] up:boot 2024-09-21T07:04:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: fsmap 7 up:standby 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: Deploying daemon mds.h on smithi129 2024-09-21T07:04:17.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/362157437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6836/499879490,v1:172.21.15.181:6837/499879490] up:boot 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: fsmap 7 up:standby 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:17.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:17.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:17.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: Deploying daemon mds.h on smithi129 2024-09-21T07:04:17.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/362157437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:17.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6836/499879490,v1:172.21.15.181:6837/499879490] up:boot 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: fsmap 7 up:standby 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: Deploying daemon mds.h on smithi129 2024-09-21T07:04:17.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/362157437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:18.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:17 smithi129 ceph-mon[34863]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:18.107 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:17 smithi129 systemd[1]: Starting Ceph mds.h for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:17 smithi181 ceph-mon[34686]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:18.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:17 smithi028 ceph-mon[31213]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:18.498 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 podman[63347]: 2024-09-21 07:04:18.091488555 +0000 UTC m=+0.015722488 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:18.498 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 podman[63347]: 2024-09-21 07:04:18.244579634 +0000 UTC m=+0.168813602 container create 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 podman[63347]: 2024-09-21 07:04:18.497103561 +0000 UTC m=+0.421337496 container init 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 podman[63347]: 2024-09-21 07:04:18.499848465 +0000 UTC m=+0.424082392 container start 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 ceph-mds[63366]: -- 172.21.15.129:0/1887322612 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560cbb3b9c20 con 0x560cbf561600 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: starting mds.h at 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 bash[63347]: 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c 2024-09-21T07:04:18.857 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:04:18 smithi129 systemd[1]: Started Ceph mds.h for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:19.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:19.634 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: Deploying daemon mds.i on smithi181 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6836/2275077942,v1:172.21.15.129:6837/2275077942] up:boot 2024-09-21T07:04:19.756 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: fsmap 8 up:standby 2024-09-21T07:04:19.757 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:19 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:04:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:20.116 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.116 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.116 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: Deploying daemon mds.i on smithi181 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6836/2275077942,v1:172.21.15.129:6837/2275077942] up:boot 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: fsmap 8 up:standby 2024-09-21T07:04:20.117 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:19 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: Deploying daemon mds.i on smithi181 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6836/2275077942,v1:172.21.15.129:6837/2275077942] up:boot 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: fsmap 8 up:standby 2024-09-21T07:04:20.118 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:19 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 -- 172.21.15.28:0/4229238612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5748108d00 msgr2=0x7f574810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 --2- 172.21.15.28:0/4229238612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5748108d00 0x7f574810f530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5740009ca0 tx=0x7f574002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 -- 172.21.15.28:0/4229238612 shutdown_connections 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 --2- 172.21.15.28:0/4229238612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5748108d00 0x7f574810f530 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 --2- 172.21.15.28:0/4229238612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57481083b0 0x7f57481087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 --2- 172.21.15.28:0/4229238612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 0x7f5748102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 -- 172.21.15.28:0/4229238612 >> 172.21.15.28:0/4229238612 conn(0x7f5748079710 msgr2=0x7f5748079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 -- 172.21.15.28:0/4229238612 shutdown_connections 2024-09-21T07:04:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.127+0000 7f574f53e640 1 -- 172.21.15.28:0/4229238612 wait complete. 2024-09-21T07:04:20.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 Processor -- start 2024-09-21T07:04:20.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 -- start start 2024-09-21T07:04:20.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 0x7f574819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5748108d00 0x7f57481a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57481129c0 con 0x7f57481083b0 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5748112840 con 0x7f5748102a70 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574f53e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5748112b40 con 0x7f5748108d00 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574cad9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574cad9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46052/0 (socket says 172.21.15.28:46052) 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574cad9640 1 -- 172.21.15.28:0/2131745293 learned_addr learned my addr 172.21.15.28:0/2131745293 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574dadb640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5748108d00 0x7f57481a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.128+0000 7f574d2da640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 0x7f574819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 -- 172.21.15.28:0/2131745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5748108d00 msgr2=0x7f57481a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5748108d00 0x7f57481a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 -- 172.21.15.28:0/2131745293 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 msgr2=0x7f574819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:20.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 0x7f574819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 -- 172.21.15.28:0/2131745293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57481a25d0 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574cad9640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f573800d950 tx=0x7f573800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738017070 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5738009c30 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57481a28c0 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.129+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57380047a0 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.130+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481a9020 con 0x7f57481083b0 2024-09-21T07:04:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.131+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5748103cf0 con 0x7f57481083b0 2024-09-21T07:04:20.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.132+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5738004020 con 0x7f57481083b0 2024-09-21T07:04:20.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.132+0000 7f573e7fc640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 0x7f57340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:20.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.133+0000 7f574d2da640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 0x7f57340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:20.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.133+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f57380e66d0 con 0x7f57481083b0 2024-09-21T07:04:20.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.133+0000 7f574d2da640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 0x7f57340b8a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f574400bbe0 tx=0x7f574400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:20.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.137+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5738020030 con 0x7f57481083b0 2024-09-21T07:04:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.366+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5748102e80 con 0x7f57481083b0 2024-09-21T07:04:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.366+0000 7f573e7fc640 1 -- 172.21.15.28:0/2131745293 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f57380ad400 con 0x7f57481083b0 2024-09-21T07:04:20.368 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:20.368 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":9,"btime":"2024-09-21T07:04:18:965235+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T07:04:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 9 2024-09-21T07:04:20.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 msgr2=0x7f57340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 0x7f57340b8a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f574400bbe0 tx=0x7f574400b390 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 msgr2=0x7f574819cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f573800d950 tx=0x7f573800de10 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 shutdown_connections 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f57340b6510 0x7f57340b8a20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5748108d00 0x7f57481a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57481083b0 0x7f574819cc00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 --2- 172.21.15.28:0/2131745293 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5748102a70 0x7f574819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 >> 172.21.15.28:0/2131745293 conn(0x7f5748079710 msgr2=0x7f574806bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 shutdown_connections 2024-09-21T07:04:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:20.369+0000 7f574f53e640 1 -- 172.21.15.28:0/2131745293 wait complete. 2024-09-21T07:04:20.639 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:20 smithi181 systemd[1]: Starting Ceph mds.i for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:20.965 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:20 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2131745293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:20.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:20 smithi181 podman[63470]: 2024-09-21 07:04:20.62378183 +0000 UTC m=+0.015885580 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:20.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:20 smithi181 podman[63470]: 2024-09-21 07:04:20.728445651 +0000 UTC m=+0.120549391 container create 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-21T07:04:20.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:20 smithi181 podman[63470]: 2024-09-21 07:04:20.964622517 +0000 UTC m=+0.356726257 container init 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:04:20.981 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:20 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2131745293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:21.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:20 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2131745293' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:21.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:20 smithi181 podman[63470]: 2024-09-21 07:04:20.967596019 +0000 UTC m=+0.359699766 container start 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T07:04:21.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mds[63489]: -- 172.21.15.181:0/3385878894 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ba5ac9860 con 0x560ba9c71600 2024-09-21T07:04:21.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: starting mds.i at 2024-09-21T07:04:21.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:21 smithi181 bash[63470]: 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc 2024-09-21T07:04:21.270 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:04:21 smithi181 systemd[1]: Started Ceph mds.i for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:21.910 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:21 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:22.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:22.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:21 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:22.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:22.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:21 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:22 smithi028 ceph-mon[31213]: Deploying daemon mds.g on smithi028 2024-09-21T07:04:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:22 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:boot 2024-09-21T07:04:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:22 smithi028 ceph-mon[31213]: fsmap 9 up:standby 2024-09-21T07:04:22.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:22 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:04:23.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:23.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:22 smithi181 ceph-mon[34686]: Deploying daemon mds.g on smithi028 2024-09-21T07:04:23.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:22 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:boot 2024-09-21T07:04:23.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:22 smithi181 ceph-mon[34686]: fsmap 9 up:standby 2024-09-21T07:04:23.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:22 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:04:23.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:22 smithi129 ceph-mon[34863]: Deploying daemon mds.g on smithi028 2024-09-21T07:04:23.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:22 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:boot 2024-09-21T07:04:23.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:22 smithi129 ceph-mon[34863]: fsmap 9 up:standby 2024-09-21T07:04:23.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:22 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:04:23.717 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:23.838 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:23 smithi028 ceph-mon[31213]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:24.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:23 smithi181 ceph-mon[34686]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:24.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:23 smithi129 ceph-mon[34863]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 -- 172.21.15.28:0/1037588692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e0108cf0 msgr2=0x7f55e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 --2- 172.21.15.28:0/1037588692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e0108cf0 0x7f55e010f520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009900 tx=0x7f55d802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 -- 172.21.15.28:0/1037588692 shutdown_connections 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 --2- 172.21.15.28:0/1037588692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e0108cf0 0x7f55e010f520 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 --2- 172.21.15.28:0/1037588692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e01083a0 0x7f55e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 --2- 172.21.15.28:0/1037588692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 0x7f55e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 -- 172.21.15.28:0/1037588692 >> 172.21.15.28:0/1037588692 conn(0x7f55e0079730 msgr2=0x7f55e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.249+0000 7f55e70ed640 1 -- 172.21.15.28:0/1037588692 shutdown_connections 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.250+0000 7f55e70ed640 1 -- 172.21.15.28:0/1037588692 wait complete. 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.250+0000 7f55e70ed640 1 Processor -- start 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.250+0000 7f55e70ed640 1 -- start start 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.250+0000 7f55e70ed640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 0x7f55e019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.250+0000 7f55e70ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e70ed640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e0108cf0 0x7f55e019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e70ed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55e01129c0 con 0x7f55e01083a0 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e70ed640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0112840 con 0x7f55e0102a60 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e70ed640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0112b40 con 0x7f55e0108cf0 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60822/0 (socket says 172.21.15.28:60822) 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 -- 172.21.15.28:0/839561228 learned_addr learned my addr 172.21.15.28:0/839561228 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:24.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e4e89640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 0x7f55e019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e568a640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e0108cf0 0x7f55e019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 -- 172.21.15.28:0/839561228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e0108cf0 msgr2=0x7f55e019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e0108cf0 0x7f55e019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 -- 172.21.15.28:0/839561228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 msgr2=0x7f55e019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 0x7f55e019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 -- 172.21.15.28:0/839561228 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e01a65c0 con 0x7f55e01083a0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55dffff640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b9c0 tx=0x7f55c800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8019070 con 0x7f55e01083a0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55c800cba0 con 0x7f55e01083a0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e01a68b0 con 0x7f55e01083a0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.251+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c80125a0 con 0x7f55e01083a0 2024-09-21T07:04:24.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.252+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01a6df0 con 0x7f55e01083a0 2024-09-21T07:04:24.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.253+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0102e70 con 0x7f55e01083a0 2024-09-21T07:04:24.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.254+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f55c801c070 con 0x7f55e01083a0 2024-09-21T07:04:24.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.255+0000 7f55ddffb640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 0x7f55cc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:24.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.255+0000 7f55e4e89640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 0x7f55cc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:24.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.255+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f55c80e6370 con 0x7f55e01083a0 2024-09-21T07:04:24.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.255+0000 7f55e4e89640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 0x7f55cc0b8a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55e006b9c0 tx=0x7f55d000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:24.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.259+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55c80b13e0 con 0x7f55e01083a0 2024-09-21T07:04:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.495+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e002e640 con 0x7f55e01083a0 2024-09-21T07:04:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.496+0000 7f55ddffb640 1 -- 172.21.15.28:0/839561228 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f55c80b6320 con 0x7f55e01083a0 2024-09-21T07:04:24.498 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:24.498 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":11,"btime":"2024-09-21T07:04:24:479636+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:04:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 11 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 msgr2=0x7f55cc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 0x7f55cc0b8a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55e006b9c0 tx=0x7f55d000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 msgr2=0x7f55e019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b9c0 tx=0x7f55c800be80 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 shutdown_connections 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f55cc0b6540 0x7f55cc0b8a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55e0108cf0 0x7f55e019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55e01083a0 0x7f55e019b870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 --2- 172.21.15.28:0/839561228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55e0102a60 0x7f55e019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 >> 172.21.15.28:0/839561228 conn(0x7f55e0079730 msgr2=0x7f55e01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 shutdown_connections 2024-09-21T07:04:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:24.498+0000 7f55e70ed640 1 -- 172.21.15.28:0/839561228 wait complete. 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: Deploying daemon mds.a on smithi028 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6838/4017087846,v1:172.21.15.28:6839/4017087846] up:boot 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: fsmap 10 up:standby 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:04:24.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:24 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/839561228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:25.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: Deploying daemon mds.a on smithi028 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6838/4017087846,v1:172.21.15.28:6839/4017087846] up:boot 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: fsmap 10 up:standby 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:04:25.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:24 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/839561228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: Deploying daemon mds.a on smithi028 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6838/4017087846,v1:172.21.15.28:6839/4017087846] up:boot 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: fsmap 10 up:standby 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:04:25.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:24 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/839561228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:26.008 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:25 smithi129 ceph-mon[34863]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:26.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:25 smithi181 ceph-mon[34686]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:26.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:25 smithi028 ceph-mon[31213]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:26.798 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:26 smithi028 systemd[1]: Starting Ceph mds.a for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:04:27.165 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:26 smithi028 podman[72457]: 2024-09-21 07:04:26.792197574 +0000 UTC m=+0.016743153 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:27.165 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:26 smithi028 podman[72457]: 2024-09-21 07:04:26.932208543 +0000 UTC m=+0.156754168 container create 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:04:27.165 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 podman[72457]: 2024-09-21 07:04:27.164179419 +0000 UTC m=+0.388724990 container init 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T07:04:27.548 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 podman[72457]: 2024-09-21 07:04:27.167212188 +0000 UTC m=+0.391757751 container start 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T07:04:27.548 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mds[72477]: -- 172.21.15.28:0/2437521931 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556adfe25860 con 0x556ae3fcda80 2024-09-21T07:04:27.548 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: starting mds.a at 2024-09-21T07:04:27.548 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 bash[72457]: 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 2024-09-21T07:04:27.548 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:04:27 smithi028 systemd[1]: Started Ceph mds.a for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:27.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:27.939 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:28.018 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:27 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:28.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:27 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:04:28.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:27 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 -- 172.21.15.28:0/1268028318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 msgr2=0x7fa45410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1268028318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45410f520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009900 tx=0x7fa44c02a410 comp rx=0 tx=0).stop 2024-09-21T07:04:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 -- 172.21.15.28:0/1268028318 shutdown_connections 2024-09-21T07:04:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1268028318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45410f520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1268028318 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4541083a0 0x7fa4541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1268028318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa454102a60 0x7fa454102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 -- 172.21.15.28:0/1268028318 >> 172.21.15.28:0/1268028318 conn(0x7fa454079730 msgr2=0x7fa454079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 -- 172.21.15.28:0/1268028318 shutdown_connections 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.437+0000 7fa458ce5640 1 -- 172.21.15.28:0/1268028318 wait complete. 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 Processor -- start 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 -- start start 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa454102a60 0x7fa45419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 0x7fa45419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa454113ac0 con 0x7fa454108cf0 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa454113940 con 0x7fa454102a60 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.438+0000 7fa458ce5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa454113c40 con 0x7fa4541083a0 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60852/0 (socket says 172.21.15.28:60852) 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 -- 172.21.15.28:0/1042772525 learned_addr learned my addr 172.21.15.28:0/1042772525 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa45259c640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa454102a60 0x7fa45419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa451d9b640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 0x7fa45419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 -- 172.21.15.28:0/1042772525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 msgr2=0x7fa45419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 0x7fa45419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 -- 172.21.15.28:0/1042772525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa454102a60 msgr2=0x7fa45419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa454102a60 0x7fa45419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 -- 172.21.15.28:0/1042772525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4541a0420 con 0x7fa454108cf0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa451d9b640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 0x7fa45419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa452d9d640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa44c004770 tx=0x7fa44c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c03f030 con 0x7fa454108cf0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4541a06b0 con 0x7fa454108cf0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa44c003aa0 con 0x7fa454108cf0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c035070 con 0x7fa454108cf0 2024-09-21T07:04:28.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.439+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4541a6e70 con 0x7fa454108cf0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.440+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa454102e70 con 0x7fa454108cf0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.442+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa44c042030 con 0x7fa454108cf0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.443+0000 7fa4437fe640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 0x7fa43c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.443+0000 7fa45259c640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 0x7fa43c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.443+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fa44c107780 con 0x7fa454108cf0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.444+0000 7fa45259c640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 0x7fa43c0b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa44400a400 tx=0x7fa44400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:28.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.446+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa44c0ce490 con 0x7fa454108cf0 2024-09-21T07:04:28.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.674+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa45419b5e0 con 0x7fa454108cf0 2024-09-21T07:04:28.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.675+0000 7fa4437fe640 1 -- 172.21.15.28:0/1042772525 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7fa45419b5e0 con 0x7fa454108cf0 2024-09-21T07:04:28.677 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:28.677 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":12,"btime":"2024-09-21T07:04:27:710063+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-09-21T07:04:28.678 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 12 2024-09-21T07:04:28.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 msgr2=0x7fa43c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 0x7fa43c0b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa44400a400 tx=0x7fa44400d040 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 msgr2=0x7fa45419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa44c004770 tx=0x7fa44c004270 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 shutdown_connections 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa43c0b6510 0x7fa43c0b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa454108cf0 0x7fa45419fcf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4541083a0 0x7fa45419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 --2- 172.21.15.28:0/1042772525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa454102a60 0x7fa45419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 >> 172.21.15.28:0/1042772525 conn(0x7fa454079730 msgr2=0x7fa4541052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 shutdown_connections 2024-09-21T07:04:28.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:28.677+0000 7fa458ce5640 1 -- 172.21.15.28:0/1042772525 wait complete. 2024-09-21T07:04:28.997 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:28 smithi129 ceph-mon[34863]: Deploying daemon mds.b on smithi129 2024-09-21T07:04:28.997 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:28 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:boot 2024-09-21T07:04:28.997 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:28 smithi129 ceph-mon[34863]: fsmap 11 up:standby 2024-09-21T07:04:28.997 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:28 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:04:28.998 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:28 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1042772525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:29.008 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:28 smithi028 ceph-mon[31213]: Deploying daemon mds.b on smithi129 2024-09-21T07:04:29.008 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:28 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:boot 2024-09-21T07:04:29.008 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:28 smithi028 ceph-mon[31213]: fsmap 11 up:standby 2024-09-21T07:04:29.009 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:28 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:04:29.009 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:28 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1042772525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:28 smithi181 ceph-mon[34686]: Deploying daemon mds.b on smithi129 2024-09-21T07:04:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:28 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:boot 2024-09-21T07:04:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:28 smithi181 ceph-mon[34686]: fsmap 11 up:standby 2024-09-21T07:04:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:28 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:04:29.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:28 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1042772525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:30.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:29 smithi181 ceph-mon[34686]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:30.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:29 smithi028 ceph-mon[31213]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:30.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:29 smithi129 ceph-mon[34863]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:30.106 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:04:29 smithi129 systemd[1]: Started Ceph mds.b for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:04:31.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:boot 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: fsmap 12 up:standby 2024-09-21T07:04:31.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:30 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:04:31.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:31.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:boot 2024-09-21T07:04:31.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: fsmap 12 up:standby 2024-09-21T07:04:31.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:30 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:04:31.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:04:31.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:boot 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: fsmap 12 up:standby 2024-09-21T07:04:31.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:30 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:04:31.599 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:32.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 -- 172.21.15.28:0/685850573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c01094c0 msgr2=0x7f19c01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 --2- 172.21.15.28:0/685850573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c01094c0 0x7f19c01098d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009900 tx=0x7f19b402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 -- 172.21.15.28:0/685850573 shutdown_connections 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 --2- 172.21.15.28:0/685850573 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 --2- 172.21.15.28:0/685850573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c01094c0 0x7f19c01098d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 --2- 172.21.15.28:0/685850573 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c0103b80 0x7f19c0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 -- 172.21.15.28:0/685850573 >> 172.21.15.28:0/685850573 conn(0x7f19c00ff610 msgr2=0x7f19c0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 -- 172.21.15.28:0/685850573 shutdown_connections 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.107+0000 7f19c7aba640 1 -- 172.21.15.28:0/685850573 wait complete. 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 Processor -- start 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 -- start start 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 0x7f19c019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19c0113ad0 con 0x7f19c0103b80 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f19c0113950 con 0x7f19c0109e10 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c7aba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f19c0113c50 con 0x7f19c01094c0 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c5856640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c5856640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60866/0 (socket says 172.21.15.28:60866) 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c5856640 1 -- 172.21.15.28:0/883231136 learned_addr learned my addr 172.21.15.28:0/883231136 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.108+0000 7f19c5055640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 0x7f19c019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c6057640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 -- 172.21.15.28:0/883231136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 msgr2=0x7f19c019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 0x7f19c019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 -- 172.21.15.28:0/883231136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 msgr2=0x7f19c019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 -- 172.21.15.28:0/883231136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c01a0430 con 0x7f19c0103b80 2024-09-21T07:04:32.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c6057640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5055640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 0x7f19c019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c5856640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e9f0 tx=0x7f19bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00cd80 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c01a0720 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19bc0054d0 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc010690 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.109+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c01a6e80 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.111+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c0103f90 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.112+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f19bc004e30 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.113+0000 7f19b2ffd640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 0x7f19ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.113+0000 7f19c5055640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 0x7f19ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.114+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f19bc0e74a0 con 0x7f19c0103b80 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.114+0000 7f19c5055640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 0x7f19ac0b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.116+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19bc0ae130 con 0x7f19c0103b80 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:32.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:32 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:32.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:32 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:32.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:32 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.362+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c019b5f0 con 0x7f19c0103b80 2024-09-21T07:04:32.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.363+0000 7f19b2ffd640 1 -- 172.21.15.28:0/883231136 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f19bc0b2510 con 0x7f19c0103b80 2024-09-21T07:04:32.365 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:32.365 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":13,"btime":"2024-09-21T07:04:30:727034+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24623,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T07:04:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 13 2024-09-21T07:04:32.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 msgr2=0x7f19ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 0x7f19ac0b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b4031400 comp rx=0 tx=0).stop 2024-09-21T07:04:32.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 msgr2=0x7f19c019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e9f0 tx=0x7f19bc00edf0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 shutdown_connections 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f19ac0b6510 0x7f19ac0b8a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19c0109e10 0x7f19c019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19c01094c0 0x7f19c019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 --2- 172.21.15.28:0/883231136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19c0103b80 0x7f19c019a4c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 >> 172.21.15.28:0/883231136 conn(0x7f19c00ff610 msgr2=0x7f19c0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 shutdown_connections 2024-09-21T07:04:32.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:32.367+0000 7f19c7aba640 1 -- 172.21.15.28:0/883231136 wait complete. 2024-09-21T07:04:33.100 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:04:33.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:33.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:33 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/883231136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:33.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:33 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:33.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:33.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:33 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/883231136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:33.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:33 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:33.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:33.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:33 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/883231136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:04:33.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:33 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:33.903 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:34.287 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:34 smithi028 ceph-mon[31213]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:34.287 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.287 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.287 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.287 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:34 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:34 smithi129 ceph-mon[34863]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:34 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.376+0000 7f6748387640 1 -- 172.21.15.28:0/3755047710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740108d20 msgr2=0x7f674010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.376+0000 7f6748387640 1 --2- 172.21.15.28:0/3755047710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740108d20 0x7f674010f550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6738009ca0 tx=0x7f673802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 -- 172.21.15.28:0/3755047710 shutdown_connections 2024-09-21T07:04:34.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 --2- 172.21.15.28:0/3755047710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740108d20 0x7f674010f550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 --2- 172.21.15.28:0/3755047710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 0x7f67401087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 --2- 172.21.15.28:0/3755047710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740102ae0 0x7f6740102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 -- 172.21.15.28:0/3755047710 >> 172.21.15.28:0/3755047710 conn(0x7f6740079760 msgr2=0x7f6740079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 -- 172.21.15.28:0/3755047710 shutdown_connections 2024-09-21T07:04:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 -- 172.21.15.28:0/3755047710 wait complete. 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 Processor -- start 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.377+0000 7f6748387640 1 -- start start 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 0x7f6740199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740108d20 0x7f674019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6740112990 con 0x7f6740102ae0 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f6740112810 con 0x7f6740108d20 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6748387640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6740112b10 con 0x7f67401083d0 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39916/0 (socket says 172.21.15.28:39916) 2024-09-21T07:04:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 -- 172.21.15.28:0/3184792218 learned_addr learned my addr 172.21.15.28:0/3184792218 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6745922640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 0x7f6740199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746924640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740108d20 0x7f674019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 -- 172.21.15.28:0/3184792218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 msgr2=0x7f6740199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 0x7f6740199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 -- 172.21.15.28:0/3184792218 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740108d20 msgr2=0x7f674019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740108d20 0x7f674019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.378+0000 7f6746123640 1 -- 172.21.15.28:0/3184792218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674019f190 con 0x7f6740102ae0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f6746123640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f673c00e9f0 tx=0x7f673c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c00ccc0 con 0x7f6740102ae0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f673c0108e0 con 0x7f6740102ae0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c018880 con 0x7f6740102ae0 2024-09-21T07:04:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674019f480 con 0x7f6740102ae0 2024-09-21T07:04:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.379+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401a5ca0 con 0x7f6740102ae0 2024-09-21T07:04:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.380+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6740103d10 con 0x7f6740102ae0 2024-09-21T07:04:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.381+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f673c010430 con 0x7f6740102ae0 2024-09-21T07:04:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.382+0000 7f67337fe640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 0x7f672c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.382+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f673c0e72c0 con 0x7f6740102ae0 2024-09-21T07:04:34.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.382+0000 7f6745922640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 0x7f672c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.383+0000 7f6745922640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 0x7f672c0b8a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6740105f20 tx=0x7f673400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.387+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f673c0adff0 con 0x7f6740102ae0 2024-09-21T07:04:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:34 smithi181 ceph-mon[34686]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:34.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:34 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:34.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.593+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6740102ef0 con 0x7f6740102ae0 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.593+0000 7f67337fe640 1 -- 172.21.15.28:0/3184792218 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7f673c0b23d0 con 0x7f6740102ae0 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:04:34.596 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-09-21T07:04:34.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 msgr2=0x7f672c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 0x7f672c0b8a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6740105f20 tx=0x7f673400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 msgr2=0x7f67401992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f673c00e9f0 tx=0x7f673c00edf0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 shutdown_connections 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f672c0b6540 0x7f672c0b8a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6740108d20 0x7f674019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67401083d0 0x7f6740199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 --2- 172.21.15.28:0/3184792218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6740102ae0 0x7f67401992e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 >> 172.21.15.28:0/3184792218 conn(0x7f6740079760 msgr2=0x7f67401043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 shutdown_connections 2024-09-21T07:04:34.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:34.596+0000 7f6748387640 1 -- 172.21.15.28:0/3184792218 wait complete. 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3184792218' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:35.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.297 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:04:35.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:04:35.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3184792218' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:04:35.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:35.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3184792218' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:04:35.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:35.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:04:35.561 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:36.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 -- 172.21.15.28:0/3708327393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c105380 msgr2=0x7f808c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3708327393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c105380 0x7f808c10d8d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8080009900 tx=0x7f808002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:36.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 -- 172.21.15.28:0/3708327393 shutdown_connections 2024-09-21T07:04:36.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3708327393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c10de60 0x7f808c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3708327393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c105380 0x7f808c10d8d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3708327393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c104a30 0x7f808c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 -- 172.21.15.28:0/3708327393 >> 172.21.15.28:0/3708327393 conn(0x7f808c079760 msgr2=0x7f808c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 -- 172.21.15.28:0/3708327393 shutdown_connections 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.085+0000 7f8090d3d640 1 -- 172.21.15.28:0/3708327393 wait complete. 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 Processor -- start 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 -- start start 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c104a30 0x7f808c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 0x7f808c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f808c113aa0 con 0x7f808c10de60 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f808c113920 con 0x7f808c105380 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8090d3d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f808c113c20 con 0x7f808c104a30 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f808ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f8089d9b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 0x7f808c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f808ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39928/0 (socket says 172.21.15.28:39928) 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.086+0000 7f808ad9d640 1 -- 172.21.15.28:0/3323424283 learned_addr learned my addr 172.21.15.28:0/3323424283 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808a59c640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c104a30 0x7f808c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 -- 172.21.15.28:0/3323424283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c104a30 msgr2=0x7f808c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c104a30 0x7f808c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 -- 172.21.15.28:0/3323424283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 msgr2=0x7f808c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 0x7f808c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 -- 172.21.15.28:0/3323424283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808c1a0300 con 0x7f808c10de60 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f8089d9b640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 0x7f808c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f808ad9d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f808400cce0 tx=0x7f808400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400f450 con 0x7f808c10de60 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808400faa0 con 0x7f808c10de60 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808c1a05f0 con 0x7f808c10de60 2024-09-21T07:04:36.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084018b70 con 0x7f808c10de60 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.087+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808c1a0ab0 con 0x7f808c10de60 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.088+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f808c06c1f0 con 0x7f808c10de60 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.090+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8084018d10 con 0x7f808c10de60 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.091+0000 7f807b7fe640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 0x7f80740b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.091+0000 7f808a59c640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 0x7f80740b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.091+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f80840e7280 con 0x7f808c10de60 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.091+0000 7f808a59c640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 0x7f80740b8a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f808c06c8f0 tx=0x7f807c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:36.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.094+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8084014030 con 0x7f808c10de60 2024-09-21T07:04:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:36.282+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f808c104e40 con 0x7f808c10de60 2024-09-21T07:04:36.284 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:36 smithi028 ceph-mon[31213]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:36.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:36 smithi129 ceph-mon[34863]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:36.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:36 smithi181 ceph-mon[34686]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:37.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.035+0000 7f807b7fe640 1 -- 172.21.15.28:0/3323424283 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7f80840ae040 con 0x7f808c10de60 2024-09-21T07:04:37.037 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.038+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 msgr2=0x7f80740b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.038+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 0x7f80740b8a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f808c06c8f0 tx=0x7f807c005f90 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.038+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 msgr2=0x7f808c19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.038+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f808400cce0 tx=0x7f808400a620 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 shutdown_connections 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f80740b6540 0x7f80740b8a50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f808c10de60 0x7f808c19fc90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f808c105380 0x7f808c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 --2- 172.21.15.28:0/3323424283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f808c104a30 0x7f808c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 >> 172.21.15.28:0/3323424283 conn(0x7f808c079760 msgr2=0x7f808c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:37.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 shutdown_connections 2024-09-21T07:04:37.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:37.039+0000 7f8090d3d640 1 -- 172.21.15.28:0/3323424283 wait complete. 2024-09-21T07:04:37.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:37 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:04:37.313 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:37 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:04:37.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:37 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:04:37.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:04:37.981 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:38.284 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:38 smithi028 ceph-mon[31213]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:38.284 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:38 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:04:38.284 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:38 smithi028 ceph-mon[31213]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:04:38.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:38 smithi129 ceph-mon[34863]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:38.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:38 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:04:38.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:38 smithi129 ceph-mon[34863]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:04:38.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 -- 172.21.15.28:0/2086877714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad0108cf0 msgr2=0x7ffad010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2086877714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad0108cf0 0x7ffad010f520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009ca0 tx=0x7ffac802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 -- 172.21.15.28:0/2086877714 shutdown_connections 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2086877714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad0108cf0 0x7ffad010f520 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2086877714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad01083a0 0x7ffad01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2086877714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 0x7ffad0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 -- 172.21.15.28:0/2086877714 >> 172.21.15.28:0/2086877714 conn(0x7ffad0079730 msgr2=0x7ffad0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 -- 172.21.15.28:0/2086877714 shutdown_connections 2024-09-21T07:04:38.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.512+0000 7ffad6f06640 1 -- 172.21.15.28:0/2086877714 wait complete. 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 Processor -- start 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 -- start start 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 0x7ffad019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad0108cf0 0x7ffad019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0112960 con 0x7ffad01083a0 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01127e0 con 0x7ffad0102a60 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad6f06640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0112ae0 con 0x7ffad0108cf0 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffacffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffacffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39942/0 (socket says 172.21.15.28:39942) 2024-09-21T07:04:38.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffacffff640 1 -- 172.21.15.28:0/2007838093 learned_addr learned my addr 172.21.15.28:0/2007838093 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad54a3640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad0108cf0 0x7ffad019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffad4ca2640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 0x7ffad019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.513+0000 7ffacffff640 1 -- 172.21.15.28:0/2007838093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad0108cf0 msgr2=0x7ffad019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacffff640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad0108cf0 0x7ffad019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacffff640 1 -- 172.21.15.28:0/2007838093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 msgr2=0x7ffad019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacffff640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 0x7ffad019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacffff640 1 -- 172.21.15.28:0/2007838093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad01a02f0 con 0x7ffad01083a0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacffff640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c970 tx=0x7ffac400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4014070 con 0x7ffad01083a0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac4004440 con 0x7ffad01083a0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad01a05e0 con 0x7ffad01083a0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4003e50 con 0x7ffad01083a0 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.514+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad01a6e00 con 0x7ffad01083a0 2024-09-21T07:04:38.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.515+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad0102e70 con 0x7ffad01083a0 2024-09-21T07:04:38.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.517+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ffac4017070 con 0x7ffad01083a0 2024-09-21T07:04:38.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:38 smithi181 ceph-mon[34686]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:38.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:38 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3323424283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:04:38.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:38 smithi181 ceph-mon[34686]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:04:38.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.517+0000 7ffacdffb640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 0x7ffab80b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.518+0000 7ffad4ca2640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 0x7ffab80b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.518+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7497+0+0 (secure 0 0 0) 0x7ffac40e69a0 con 0x7ffad01083a0 2024-09-21T07:04:38.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.518+0000 7ffad4ca2640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 0x7ffab80b8bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffac000bbe0 tx=0x7ffac000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:38.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.522+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffac401e030 con 0x7ffad01083a0 2024-09-21T07:04:38.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:38.709+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffad002e640 con 0x7ffad01083a0 2024-09-21T07:04:39.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.042+0000 7ffacdffb640 1 -- 172.21.15.28:0/2007838093 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7ffac40ad560 con 0x7ffad01083a0 2024-09-21T07:04:39.045 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 msgr2=0x7ffab80b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 0x7ffab80b8bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffac000bbe0 tx=0x7ffac000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 msgr2=0x7ffad019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c970 tx=0x7ffac400ce30 comp rx=0 tx=0).stop 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 shutdown_connections 2024-09-21T07:04:39.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ffab80b66e0 0x7ffab80b8bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffad0108cf0 0x7ffad019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad01083a0 0x7ffad019a9e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 --2- 172.21.15.28:0/2007838093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0102a60 0x7ffad019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 >> 172.21.15.28:0/2007838093 conn(0x7ffad0079730 msgr2=0x7ffad006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 shutdown_connections 2024-09-21T07:04:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:39.046+0000 7ffad6f06640 1 -- 172.21.15.28:0/2007838093 wait complete. 2024-09-21T07:04:39.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:39 smithi028 ceph-mon[31213]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:04:39.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:39 smithi028 ceph-mon[31213]: pgmap v282: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:39.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:39 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:04:39.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:39 smithi129 ceph-mon[34863]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:04:39.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:39 smithi129 ceph-mon[34863]: pgmap v282: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:39.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:39 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:04:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:39 smithi181 ceph-mon[34686]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:04:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:39 smithi181 ceph-mon[34686]: pgmap v282: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:39 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:04:39.722 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:04:39.986 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:40.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:40 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:04:40.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:40 smithi028 ceph-mon[31213]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:04:40.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:40 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:04:40.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:40 smithi129 ceph-mon[34863]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:04:40.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:40 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2007838093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:04:40.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:40 smithi181 ceph-mon[34686]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:04:40.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 -- 172.21.15.28:0/83006336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c104a30 msgr2=0x7f172c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 --2- 172.21.15.28:0/83006336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c104a30 0x7f172c104e40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1724009900 tx=0x7f172402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:40.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 -- 172.21.15.28:0/83006336 shutdown_connections 2024-09-21T07:04:40.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 --2- 172.21.15.28:0/83006336 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c10de60 0x7f172c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 --2- 172.21.15.28:0/83006336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 0x7f172c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 --2- 172.21.15.28:0/83006336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c104a30 0x7f172c104e40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 -- 172.21.15.28:0/83006336 >> 172.21.15.28:0/83006336 conn(0x7f172c0797b0 msgr2=0x7f172c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 -- 172.21.15.28:0/83006336 shutdown_connections 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.525+0000 7f173178c640 1 -- 172.21.15.28:0/83006336 wait complete. 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 Processor -- start 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 -- start start 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c104a30 0x7f172c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 0x7f172c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f172c113ac0 con 0x7f172c10de60 2024-09-21T07:04:40.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f172c113940 con 0x7f172c104a30 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f173178c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f172c113c40 con 0x7f172c105380 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f172b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f172b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39960/0 (socket says 172.21.15.28:39960) 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f172b7fe640 1 -- 172.21.15.28:0/3129015286 learned_addr learned my addr 172.21.15.28:0/3129015286 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.526+0000 7f172affd640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c104a30 0x7f172c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172a7fc640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 0x7f172c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 -- 172.21.15.28:0/3129015286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 msgr2=0x7f172c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 0x7f172c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 -- 172.21.15.28:0/3129015286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c104a30 msgr2=0x7f172c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c104a30 0x7f172c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 -- 172.21.15.28:0/3129015286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c1a0400 con 0x7f172c10de60 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f172b7fe640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f171c00eaa0 tx=0x7f171c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:40.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00cdb0 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f171c005020 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0116d0 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c1a06f0 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.527+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c1a6e50 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.528+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c104e40 con 0x7f172c10de60 2024-09-21T07:04:40.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.530+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f171c0051d0 con 0x7f172c10de60 2024-09-21T07:04:40.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.531+0000 7f1723fff640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 0x7f17180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.531+0000 7f172affd640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 0x7f17180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.531+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7879+0+0 (secure 0 0 0) 0x7f171c0e76d0 con 0x7f172c10de60 2024-09-21T07:04:40.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.532+0000 7f172affd640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 0x7f17180b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1724031440 tx=0x7f1724009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:40.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.534+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f171c016030 con 0x7f172c10de60 2024-09-21T07:04:40.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:40.760+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f172c108fa0 con 0x7f172c10de60 2024-09-21T07:04:41.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.060+0000 7f1723fff640 1 -- 172.21.15.28:0/3129015286 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f171c0ae110 con 0x7f172c10de60 2024-09-21T07:04:41.063 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 msgr2=0x7f17180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 0x7f17180b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1724031440 tx=0x7f1724009560 comp rx=0 tx=0).stop 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 msgr2=0x7f172c19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f171c00eaa0 tx=0x7f171c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 shutdown_connections 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17180b6510 0x7f17180b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f172c10de60 0x7f172c19fcd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f172c105380 0x7f172c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:41.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 --2- 172.21.15.28:0/3129015286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f172c104a30 0x7f172c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:41.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 >> 172.21.15.28:0/3129015286 conn(0x7f172c0797b0 msgr2=0x7f172c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:41.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 shutdown_connections 2024-09-21T07:04:41.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:41.064+0000 7f173178c640 1 -- 172.21.15.28:0/3129015286 wait complete. 2024-09-21T07:04:41.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:41 smithi129 ceph-mon[34863]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:04:41.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:41 smithi129 ceph-mon[34863]: pgmap v285: 97 pgs: 15 creating+peering, 61 unknown, 21 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:41.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:41 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:04:41.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:41 smithi129 ceph-mon[34863]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:04:41.437 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:41 smithi028 ceph-mon[31213]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:04:41.437 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:41 smithi028 ceph-mon[31213]: pgmap v285: 97 pgs: 15 creating+peering, 61 unknown, 21 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:41.437 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:41 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:04:41.437 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:41 smithi028 ceph-mon[31213]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:04:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:41 smithi181 ceph-mon[34686]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:04:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:41 smithi181 ceph-mon[34686]: pgmap v285: 97 pgs: 15 creating+peering, 61 unknown, 21 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:04:41.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:41 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:04:41.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:41 smithi181 ceph-mon[34686]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:04:41.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:04:42.094 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:42.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:42 smithi129 ceph-mon[34863]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:04:42.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:42 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:04:42.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:42 smithi129 ceph-mon[34863]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:04:42.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:42 smithi129 ceph-mon[34863]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:04:42.404 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:42 smithi028 ceph-mon[31213]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:04:42.404 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:42 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:04:42.404 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:42 smithi028 ceph-mon[31213]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:04:42.404 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:42 smithi028 ceph-mon[31213]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:04:42.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:42 smithi181 ceph-mon[34686]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:04:42.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:42 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3129015286' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:04:42.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:42 smithi181 ceph-mon[34686]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:04:42.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:42 smithi181 ceph-mon[34686]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 -- 172.21.15.28:0/1224073762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 msgr2=0x7fce2010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 --2- 172.21.15.28:0/1224073762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2010f540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce18009ca0 tx=0x7fce1802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 -- 172.21.15.28:0/1224073762 shutdown_connections 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 --2- 172.21.15.28:0/1224073762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2010f540 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 --2- 172.21.15.28:0/1224073762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 0x7fce201087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 --2- 172.21.15.28:0/1224073762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 0x7fce20102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 -- 172.21.15.28:0/1224073762 >> 172.21.15.28:0/1224073762 conn(0x7fce20079740 msgr2=0x7fce20079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 -- 172.21.15.28:0/1224073762 shutdown_connections 2024-09-21T07:04:42.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.649+0000 7fce2491a640 1 -- 172.21.15.28:0/1224073762 wait complete. 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.650+0000 7fce2491a640 1 Processor -- start 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.650+0000 7fce2491a640 1 -- start start 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 0x7fce2019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 0x7fce2019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112a00 con 0x7fce20108d10 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112880 con 0x7fce201083c0 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112b80 con 0x7fce20102a80 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51720/0 (socket says 172.21.15.28:51720) 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 -- 172.21.15.28:0/2131198394 learned_addr learned my addr 172.21.15.28:0/2131198394 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:42.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1e59c640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 0x7fce2019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1dd9b640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 0x7fce2019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 -- 172.21.15.28:0/2131198394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 msgr2=0x7fce2019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 0x7fce2019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 -- 172.21.15.28:0/2131198394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 msgr2=0x7fce2019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 0x7fce2019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 -- 172.21.15.28:0/2131198394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a04b0 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce1ed9d640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce18005cc0 tx=0x7fce1802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18003bf0 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a0740 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce18003d90 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.651+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1802fb20 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.652+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a6f00 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.653+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce20103d00 con 0x7fce20108d10 2024-09-21T07:04:42.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.655+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fce18004580 con 0x7fce20108d10 2024-09-21T07:04:42.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.656+0000 7fce0f7fe640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 0x7fce080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:42.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.656+0000 7fce1e59c640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 0x7fce080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:42.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.656+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fce181086d0 con 0x7fce20108d10 2024-09-21T07:04:42.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.657+0000 7fce1e59c640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 0x7fce080b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce10005fd0 tx=0x7fce1000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:42.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.660+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce180cf010 con 0x7fce20108d10 2024-09-21T07:04:42.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.849+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce2010bb10 con 0x7fce20108d10 2024-09-21T07:04:42.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.851+0000 7fce0f7fe640 1 -- 172.21.15.28:0/2131198394 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22300 (secure 0 0 0) 0x7fce180d33f0 con 0x7fce20108d10 2024-09-21T07:04:42.853 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:42.853 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:04:40.762279+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 msgr2=0x7fce080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 0x7fce080b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce10005fd0 tx=0x7fce1000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 msgr2=0x7fce2019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce18005cc0 tx=0x7fce1802f380 comp rx=0 tx=0).stop 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 shutdown_connections 2024-09-21T07:04:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fce080b6510 0x7fce080b8a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce20108d10 0x7fce2019fd80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce201083c0 0x7fce2019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 --2- 172.21.15.28:0/2131198394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce20102a80 0x7fce2019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 >> 172.21.15.28:0/2131198394 conn(0x7fce20079740 msgr2=0x7fce2006bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 shutdown_connections 2024-09-21T07:04:42.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:42.853+0000 7fce2491a640 1 -- 172.21.15.28:0/2131198394 wait complete. 2024-09-21T07:04:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:43 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:active 2024-09-21T07:04:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:43 smithi129 ceph-mon[34863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:43 smithi129 ceph-mon[34863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:43 smithi129 ceph-mon[34863]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:04:43.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:43 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2131198394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:43 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:active 2024-09-21T07:04:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:43 smithi181 ceph-mon[34686]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:43 smithi181 ceph-mon[34686]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:43 smithi181 ceph-mon[34686]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:04:43.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:43 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2131198394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:43.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:43 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] up:active 2024-09-21T07:04:43.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:43 smithi028 ceph-mon[31213]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:43 smithi028 ceph-mon[31213]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:43.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:43 smithi028 ceph-mon[31213]: pgmap v287: 97 pgs: 15 creating+peering, 31 unknown, 51 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:04:43.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:43 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2131198394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:43.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:04:43.842 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:44.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 -- 172.21.15.28:0/593712122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf70109e40 msgr2=0x7faf70110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:44.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 --2- 172.21.15.28:0/593712122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf70109e40 0x7faf70110670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf68009900 tx=0x7faf6802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 -- 172.21.15.28:0/593712122 shutdown_connections 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 --2- 172.21.15.28:0/593712122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf70109e40 0x7faf70110670 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 --2- 172.21.15.28:0/593712122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf701094f0 0x7faf70109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 --2- 172.21.15.28:0/593712122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf70103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 -- 172.21.15.28:0/593712122 >> 172.21.15.28:0/593712122 conn(0x7faf700ff600 msgr2=0x7faf70101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 -- 172.21.15.28:0/593712122 shutdown_connections 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.350+0000 7faf77352640 1 -- 172.21.15.28:0/593712122 wait complete. 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 Processor -- start 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 -- start start 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf7019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf70109e40 0x7faf7019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf70113b00 con 0x7faf701094f0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7faf70113980 con 0x7faf70103bb0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf77352640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf70113c80 con 0x7faf70109e40 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51738/0 (socket says 172.21.15.28:51738) 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 -- 172.21.15.28:0/2567568312 learned_addr learned my addr 172.21.15.28:0/2567568312 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf758ef640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf70109e40 0x7faf7019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf750ee640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf7019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 -- 172.21.15.28:0/2567568312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf70109e40 msgr2=0x7faf7019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf70109e40 0x7faf7019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 -- 172.21.15.28:0/2567568312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 msgr2=0x7faf7019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf7019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf748ed640 1 -- 172.21.15.28:0/2567568312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf701a03e0 con 0x7faf701094f0 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.351+0000 7faf750ee640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf7019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf748ed640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf6400d750 tx=0x7faf6400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64017070 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf640054d0 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf701a06d0 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64004c30 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.352+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf701a6e30 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.353+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70104e30 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.354+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7faf64004dd0 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.355+0000 7faf6e7fc640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 0x7faf580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.355+0000 7faf750ee640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 0x7faf580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.355+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7faf640e6fb0 con 0x7faf701094f0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.356+0000 7faf750ee640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 0x7faf580b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faf60005fd0 tx=0x7faf60009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.358+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf640ad8f0 con 0x7faf701094f0 2024-09-21T07:04:44.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.550+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf7010bc30 con 0x7faf701094f0 2024-09-21T07:04:44.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.552+0000 7faf6e7fc640 1 -- 172.21.15.28:0/2567568312 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22300 (secure 0 0 0) 0x7faf640b1cd0 con 0x7faf701094f0 2024-09-21T07:04:44.554 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:04:44.554 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:04:40.762279+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:04:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 msgr2=0x7faf580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 0x7faf580b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faf60005fd0 tx=0x7faf60009600 comp rx=0 tx=0).stop 2024-09-21T07:04:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 msgr2=0x7faf7019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf6400d750 tx=0x7faf6400dc10 comp rx=0 tx=0).stop 2024-09-21T07:04:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 shutdown_connections 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7faf580b6510 0x7faf580b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf70109e40 0x7faf7019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf701094f0 0x7faf7019aa10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 --2- 172.21.15.28:0/2567568312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf70103bb0 0x7faf7019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 >> 172.21.15.28:0/2567568312 conn(0x7faf700ff600 msgr2=0x7faf70101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 shutdown_connections 2024-09-21T07:04:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:44.554+0000 7faf77352640 1 -- 172.21.15.28:0/2567568312 wait complete. 2024-09-21T07:04:45.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:04:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:45.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:45 smithi028 ceph-mon[31213]: pgmap v288: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T07:04:45.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:45 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2567568312' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:45.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:45 smithi129 ceph-mon[34863]: pgmap v288: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T07:04:45.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:45 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2567568312' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:45 smithi181 ceph-mon[34686]: pgmap v288: 97 pgs: 15 creating+peering, 82 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-21T07:04:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:45 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2567568312' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.996+0000 7fc9fab52640 1 -- 172.21.15.28:0/1340878872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4102a80 msgr2=0x7fc9f4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.996+0000 7fc9fab52640 1 --2- 172.21.15.28:0/1340878872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4102a80 0x7fc9f4102e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009900 tx=0x7fc9e802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 -- 172.21.15.28:0/1340878872 shutdown_connections 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 --2- 172.21.15.28:0/1340878872 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4108d10 0x7fc9f410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 --2- 172.21.15.28:0/1340878872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 0x7fc9f41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 --2- 172.21.15.28:0/1340878872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4102a80 0x7fc9f4102e90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 -- 172.21.15.28:0/1340878872 >> 172.21.15.28:0/1340878872 conn(0x7fc9f4079740 msgr2=0x7fc9f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 -- 172.21.15.28:0/1340878872 shutdown_connections 2024-09-21T07:04:46.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 -- 172.21.15.28:0/1340878872 wait complete. 2024-09-21T07:04:46.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 Processor -- start 2024-09-21T07:04:46.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.997+0000 7fc9fab52640 1 -- start start 2024-09-21T07:04:46.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4102a80 0x7fc9f419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 0x7fc9f419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4112980 con 0x7fc9f4108d10 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4112800 con 0x7fc9f4102a80 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9fab52640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4112b00 con 0x7fc9f41083c0 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51754/0 (socket says 172.21.15.28:51754) 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 -- 172.21.15.28:0/307481522 learned_addr learned my addr 172.21.15.28:0/307481522 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f88ee640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4102a80 0x7fc9f419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f3fff640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 0x7fc9f419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 -- 172.21.15.28:0/307481522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 msgr2=0x7fc9f419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 0x7fc9f419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 -- 172.21.15.28:0/307481522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4102a80 msgr2=0x7fc9f419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4102a80 0x7fc9f419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.998+0000 7fc9f90ef640 1 -- 172.21.15.28:0/307481522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f41a0310 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9f90ef640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009fd0 tx=0x7fc9ec00def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec017070 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9ec003e20 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f41a0600 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec010460 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:45.999+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f4104150 con 0x7fc9f4108d10 2024-09-21T07:04:46.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.000+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f4103d00 con 0x7fc9f4108d10 2024-09-21T07:04:46.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.002+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc9ec004020 con 0x7fc9f4108d10 2024-09-21T07:04:46.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.003+0000 7fc9f1ffb640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 0x7fc9e40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.003+0000 7fc9f88ee640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 0x7fc9e40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.003+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fc9ec0e6e00 con 0x7fc9f4108d10 2024-09-21T07:04:46.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.003+0000 7fc9f88ee640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 0x7fc9e40b8a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8031440 tx=0x7fc9e8009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.009+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9ec0ad7e0 con 0x7fc9f4108d10 2024-09-21T07:04:46.107 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:04:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: 2024-09-21T07:04:45.736+0000 7fbd8cb6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:04:46.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.237+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9f4063fc0 con 0x7fc9f4108d10 2024-09-21T07:04:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.318+0000 7fc9f1ffb640 1 -- 172.21.15.28:0/307481522 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc9ec0b1bc0 con 0x7fc9f4108d10 2024-09-21T07:04:46.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.320+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 msgr2=0x7fc9e40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.320+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 0x7fc9e40b8a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8031440 tx=0x7fc9e8009560 comp rx=0 tx=0).stop 2024-09-21T07:04:46.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.320+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 msgr2=0x7fc9f419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.320+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009fd0 tx=0x7fc9ec00def0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 shutdown_connections 2024-09-21T07:04:46.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc9e40b6540 0x7fc9e40b8a50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9f4108d10 0x7fc9f419fca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9f41083c0 0x7fc9f419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 --2- 172.21.15.28:0/307481522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9f4102a80 0x7fc9f419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 >> 172.21.15.28:0/307481522 conn(0x7fc9f4079740 msgr2=0x7fc9f4101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 shutdown_connections 2024-09-21T07:04:46.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:46.321+0000 7fc9fab52640 1 -- 172.21.15.28:0/307481522 wait complete. 2024-09-21T07:04:46.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:46 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:04:46.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:46 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:04:46.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:46 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:04:47.032 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T07:04:47.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T07:04:47.292 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:47.580 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:47 smithi028 ceph-mon[31213]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T07:04:47.581 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:47 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:04:47.581 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:47 smithi028 ceph-mon[31213]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:47.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:47 smithi129 ceph-mon[34863]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T07:04:47.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:47 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:04:47.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:47 smithi129 ceph-mon[34863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:47.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:47 smithi181 ceph-mon[34686]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T07:04:47.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:47 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/307481522' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:04:47.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:47 smithi181 ceph-mon[34686]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 -- 172.21.15.28:0/218066223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc641083d0 msgr2=0x7efc641087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 --2- 172.21.15.28:0/218066223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc641083d0 0x7efc641087e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efc58009900 tx=0x7efc5802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 -- 172.21.15.28:0/218066223 shutdown_connections 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 --2- 172.21.15.28:0/218066223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc64108d20 0x7efc6410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 --2- 172.21.15.28:0/218066223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc641083d0 0x7efc641087e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 --2- 172.21.15.28:0/218066223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64102a90 0x7efc64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 -- 172.21.15.28:0/218066223 >> 172.21.15.28:0/218066223 conn(0x7efc64079750 msgr2=0x7efc64079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 -- 172.21.15.28:0/218066223 shutdown_connections 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.798+0000 7efc68bd0640 1 -- 172.21.15.28:0/218066223 wait complete. 2024-09-21T07:04:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 Processor -- start 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 -- start start 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 0x7efc64199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 0x7efc6419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc64112990 con 0x7efc64102a90 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7efc64112810 con 0x7efc64108d20 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc68bd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc64112b10 con 0x7efc641083d0 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc6259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc6259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51772/0 (socket says 172.21.15.28:51772) 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc6259c640 1 -- 172.21.15.28:0/1909802455 learned_addr learned my addr 172.21.15.28:0/1909802455 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.799+0000 7efc61d9b640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 0x7efc64199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc62d9d640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 0x7efc6419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 -- 172.21.15.28:0/1909802455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 msgr2=0x7efc64199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 0x7efc64199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 -- 172.21.15.28:0/1909802455 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 msgr2=0x7efc6419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 0x7efc6419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 -- 172.21.15.28:0/1909802455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6419f230 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc61d9b640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 0x7efc64199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc62d9d640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 0x7efc6419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc6259c640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc54009900 tx=0x7efc54009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5400d030 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc5400d1d0 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6419f520 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54005280 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.800+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6406bb80 con 0x7efc64102a90 2024-09-21T07:04:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.801+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc64103d10 con 0x7efc64102a90 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.803+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efc54005420 con 0x7efc64102a90 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.803+0000 7efc537fe640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 0x7efc4c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.804+0000 7efc61d9b640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 0x7efc4c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.804+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7efc540e89c0 con 0x7efc64102a90 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.804+0000 7efc61d9b640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 0x7efc4c0b8ad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58032da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:47.807+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc540af3a0 con 0x7efc64102a90 2024-09-21T07:04:48.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.033+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7efc6406c600 con 0x7efc64102a90 2024-09-21T07:04:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.329+0000 7efc537fe640 1 -- 172.21.15.28:0/1909802455 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7efc540b3780 con 0x7efc64102a90 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 msgr2=0x7efc4c0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 0x7efc4c0b8ad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58032da0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 msgr2=0x7efc64199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efc54009900 tx=0x7efc54009dc0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 shutdown_connections 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc4c0b65c0 0x7efc4c0b8ad0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc64108d20 0x7efc6419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc641083d0 0x7efc64199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.331+0000 7efc68bd0640 1 --2- 172.21.15.28:0/1909802455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc64102a90 0x7efc64199380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.332+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 >> 172.21.15.28:0/1909802455 conn(0x7efc64079750 msgr2=0x7efc641044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.332+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 shutdown_connections 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:48.332+0000 7efc68bd0640 1 -- 172.21.15.28:0/1909802455 wait complete. 2024-09-21T07:04:48.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:48 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:04:48.630 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:48 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:04:48.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:48 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:04:49.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:04:49.300 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:49.575 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:04:49.575 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:04:49.575 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:04:49.576 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:04:49.576 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:49.576 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-21T07:04:49.576 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:49 smithi028 ceph-mon[31213]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-21T07:04:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:49 smithi129 ceph-mon[34863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-21T07:04:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:04:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:04:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1909802455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:04:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:04:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:04:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-21T07:04:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:49 smithi181 ceph-mon[34686]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 -- 172.21.15.28:0/1375775800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8103bb0 msgr2=0x7f06e8103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 --2- 172.21.15.28:0/1375775800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8103bb0 0x7f06e8103fc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009900 tx=0x7f06dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 -- 172.21.15.28:0/1375775800 shutdown_connections 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 --2- 172.21.15.28:0/1375775800 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e8109e40 0x7f06e8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 --2- 172.21.15.28:0/1375775800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e81094f0 0x7f06e8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 --2- 172.21.15.28:0/1375775800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8103bb0 0x7f06e8103fc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 -- 172.21.15.28:0/1375775800 >> 172.21.15.28:0/1375775800 conn(0x7f06e80ff600 msgr2=0x7f06e8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 -- 172.21.15.28:0/1375775800 shutdown_connections 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 -- 172.21.15.28:0/1375775800 wait complete. 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.792+0000 7f06eec6e640 1 Processor -- start 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 -- start start 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e8103bb0 0x7f06e819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 0x7f06e819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8113b40 con 0x7f06e8109e40 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81139c0 con 0x7f06e81094f0 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eec6e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8113cc0 con 0x7f06e8103bb0 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51786/0 (socket says 172.21.15.28:51786) 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 -- 172.21.15.28:0/2251969645 learned_addr learned my addr 172.21.15.28:0/2251969645 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06eca0a640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e8103bb0 0x7f06e819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06e7fff640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 0x7f06e819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 -- 172.21.15.28:0/2251969645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e8103bb0 msgr2=0x7f06e819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e8103bb0 0x7f06e819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 -- 172.21.15.28:0/2251969645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 msgr2=0x7f06e819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 0x7f06e819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 -- 172.21.15.28:0/2251969645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81a0520 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06e7fff640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 0x7f06e819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.793+0000 7f06ed20b640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06e000eaa0 tx=0x7f06e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.794+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e000cdb0 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.794+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e0005020 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.794+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81a0810 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.794+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00116d0 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.794+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81a6f70 con 0x7f06e8109e40 2024-09-21T07:04:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.795+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8103fc0 con 0x7f06e8109e40 2024-09-21T07:04:49.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.797+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f06e00051d0 con 0x7f06e8109e40 2024-09-21T07:04:49.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.797+0000 7f06e5ffb640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 0x7f06d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.797+0000 7f06eca0a640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 0x7f06d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.797+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f06e00e7410 con 0x7f06e8109e40 2024-09-21T07:04:49.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.798+0000 7f06eca0a640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 0x7f06d80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06dc031440 tx=0x7f06dc005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:49.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:49.802+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06e0016030 con 0x7f06e8109e40 2024-09-21T07:04:50.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.030+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f06e802e640 con 0x7f06e8109e40 2024-09-21T07:04:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.345+0000 7f06e5ffb640 1 -- 172.21.15.28:0/2251969645 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f06e00addf0 con 0x7f06e8109e40 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 msgr2=0x7f06d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 0x7f06d80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06dc031440 tx=0x7f06dc005d50 comp rx=0 tx=0).stop 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 msgr2=0x7f06e819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06e000eaa0 tx=0x7f06e000ef60 comp rx=0 tx=0).stop 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 shutdown_connections 2024-09-21T07:04:50.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f06d80b6510 0x7f06d80b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06e8109e40 0x7f06e819fdf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06e81094f0 0x7f06e819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 --2- 172.21.15.28:0/2251969645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e8103bb0 0x7f06e819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 >> 172.21.15.28:0/2251969645 conn(0x7f06e80ff600 msgr2=0x7f06e8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 shutdown_connections 2024-09-21T07:04:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:50.348+0000 7f06eec6e640 1 -- 172.21.15.28:0/2251969645 wait complete. 2024-09-21T07:04:50.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:active 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: Cluster is now healthy 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:04:50.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:active 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: Cluster is now healthy 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-21T07:04:50.726 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:04:50.727 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:04:50.727 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:50 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] up:active 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: Cluster is now healthy 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-21T07:04:50.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:04:50.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:04:50.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:50 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:04:51.054 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:04:51.106 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: 2024-09-21T07:04:50.737+0000 7fbd8cb6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T07:04:51.106 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:04:50 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: 2024-09-21T07:04:50.737+0000 7fbd8cb6e640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T07:04:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:51.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:51 smithi028 ceph-mon[31213]: pgmap v291: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T07:04:51.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:51 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:04:51.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:51 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:active 2024-09-21T07:04:51.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:51 smithi028 ceph-mon[31213]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:04:51.600 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:51 smithi028 ceph-mon[31213]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:51.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:51 smithi129 ceph-mon[34863]: pgmap v291: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T07:04:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:51 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:04:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:51 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:active 2024-09-21T07:04:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:51 smithi129 ceph-mon[34863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:04:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:51 smithi129 ceph-mon[34863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:51 smithi181 ceph-mon[34686]: pgmap v291: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T07:04:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:51 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2251969645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:04:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:51 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] up:active 2024-09-21T07:04:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:51 smithi181 ceph-mon[34686]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:04:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:51 smithi181 ceph-mon[34686]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:51.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 -- 172.21.15.28:0/1099940341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f788410de60 msgr2=0x7f7884110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 --2- 172.21.15.28:0/1099940341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f788410de60 0x7f7884110330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f787c009ca0 tx=0x7f787c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 -- 172.21.15.28:0/1099940341 shutdown_connections 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 --2- 172.21.15.28:0/1099940341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f788410de60 0x7f7884110330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 --2- 172.21.15.28:0/1099940341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7884105380 0x7f788410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 --2- 172.21.15.28:0/1099940341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 0x7f7884104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 -- 172.21.15.28:0/1099940341 >> 172.21.15.28:0/1099940341 conn(0x7f7884079760 msgr2=0x7f7884079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 -- 172.21.15.28:0/1099940341 shutdown_connections 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.818+0000 7f788c464640 1 -- 172.21.15.28:0/1099940341 wait complete. 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.819+0000 7f788c464640 1 Processor -- start 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.819+0000 7f788c464640 1 -- start start 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.819+0000 7f788c464640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 0x7f7884102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:51.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.819+0000 7f788c464640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.819+0000 7f788c464640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f788410de60 0x7f78841031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788c464640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7884113ac0 con 0x7f7884105380 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788c464640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7884113940 con 0x7f788410de60 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788c464640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7884113c40 con 0x7f7884104a30 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51796/0 (socket says 172.21.15.28:51796) 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 -- 172.21.15.28:0/2530047577 learned_addr learned my addr 172.21.15.28:0/2530047577 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788a200640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 0x7f7884102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788aa01640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f788410de60 0x7f78841031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 -- 172.21.15.28:0/2530047577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 msgr2=0x7f7884102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 0x7f7884102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 -- 172.21.15.28:0/2530047577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f788410de60 msgr2=0x7f78841031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f788410de60 0x7f78841031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 -- 172.21.15.28:0/2530047577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78841a86f0 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f78899ff640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9f0 tx=0x7f787400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787400ccc0 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78740108e0 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78841a89e0 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874018860 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.820+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78841a8f70 con 0x7f7884105380 2024-09-21T07:04:51.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.821+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788406c1f0 con 0x7f7884105380 2024-09-21T07:04:51.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.823+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7874010430 con 0x7f7884105380 2024-09-21T07:04:51.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.824+0000 7f787b7fe640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 0x7f78700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:51.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.824+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f78740e79d0 con 0x7f7884105380 2024-09-21T07:04:51.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.824+0000 7f788a200640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 0x7f78700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:51.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.825+0000 7f788a200640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 0x7f78700b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78841041c0 tx=0x7f7880005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:51.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:51.827+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78740ae3b0 con 0x7f7884105380 2024-09-21T07:04:52.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.054+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7884103a70 con 0x7f7884105380 2024-09-21T07:04:52.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.352+0000 7f787b7fe640 1 -- 172.21.15.28:0/2530047577 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f7884103a70 con 0x7f7884105380 2024-09-21T07:04:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 msgr2=0x7f78700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 0x7f78700b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78841041c0 tx=0x7f7880005f90 comp rx=0 tx=0).stop 2024-09-21T07:04:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 msgr2=0x7f7884102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f787400e9f0 tx=0x7f787400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 shutdown_connections 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f78700b6590 0x7f78700b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f788410de60 0x7f78841031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7884105380 0x7f7884102cb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 --2- 172.21.15.28:0/2530047577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884104a30 0x7f7884102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 >> 172.21.15.28:0/2530047577 conn(0x7f7884079760 msgr2=0x7f7884105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 shutdown_connections 2024-09-21T07:04:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:52.355+0000 7f788c464640 1 -- 172.21.15.28:0/2530047577 wait complete. 2024-09-21T07:04:52.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:52 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:04:52.734 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:52 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:04:52.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:52 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:04:53.103 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T07:04:53.103 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:04:53.367 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:53 smithi129 ceph-mon[34863]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 548 B/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T07:04:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:53 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:04:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:53 smithi129 ceph-mon[34863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:53.647 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:53 smithi028 ceph-mon[31213]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 548 B/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T07:04:53.647 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:53 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:04:53.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:53 smithi028 ceph-mon[31213]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:53 smithi181 ceph-mon[34686]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 548 B/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T07:04:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:53 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2530047577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:04:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:53 smithi181 ceph-mon[34686]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 -- 172.21.15.28:0/2824729606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 msgr2=0x7f89b0103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2824729606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0103fd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009900 tx=0x7f89a002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 -- 172.21.15.28:0/2824729606 shutdown_connections 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2824729606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 0x7f89b0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2824729606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 0x7f89b01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2824729606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0103fd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 -- 172.21.15.28:0/2824729606 >> 172.21.15.28:0/2824729606 conn(0x7f89b007b910 msgr2=0x7f89b007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 -- 172.21.15.28:0/2824729606 shutdown_connections 2024-09-21T07:04:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.908+0000 7f89b68e9640 1 -- 172.21.15.28:0/2824729606 wait complete. 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 Processor -- start 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 -- start start 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 0x7f89b0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 0x7f89b0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113ac0 con 0x7f89b0103bc0 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113940 con 0x7f89b01094b0 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.909+0000 7f89b68e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0113c40 con 0x7f89b0109e00 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42438/0 (socket says 172.21.15.28:42438) 2024-09-21T07:04:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 -- 172.21.15.28:0/2170325765 learned_addr learned my addr 172.21.15.28:0/2170325765 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89b4e86640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 0x7f89b0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89a7fff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 0x7f89b0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 -- 172.21.15.28:0/2170325765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 msgr2=0x7f89b0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 0x7f89b0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 -- 172.21.15.28:0/2170325765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 msgr2=0x7f89b0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 0x7f89b0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 -- 172.21.15.28:0/2170325765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b01a87b0 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89affff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89a0005940 tx=0x7f89a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a003f030 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a0003cb0 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b01a8a40 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0035070 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.910+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b01a8f20 con 0x7f89b0103bc0 2024-09-21T07:04:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.912+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b0103fd0 con 0x7f89b0103bc0 2024-09-21T07:04:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.913+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f89a0042030 con 0x7f89b0103bc0 2024-09-21T07:04:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.914+0000 7f89adffb640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.914+0000 7f89a7fff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.914+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f89a0107ae0 con 0x7f89b0103bc0 2024-09-21T07:04:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.915+0000 7f89a7fff640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 0x7f899c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89b0109290 tx=0x7f899800b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:53.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:53.918+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89a00ce4c0 con 0x7f89b0103bc0 2024-09-21T07:04:54.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.137+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f89b0063800 con 0x7f899c0b6510 2024-09-21T07:04:54.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.159+0000 7f89adffb640 1 -- 172.21.15.28:0/2170325765 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f89b0063800 con 0x7f899c0b6510 2024-09-21T07:04:54.161 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:04:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:04:54.142+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:04:54.161 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:04:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:04:54.142+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:04:54.161 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:04:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:04:54.142+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:04:54.161 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:04:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:04:54.142+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:04:54.161 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:04:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:04:54.142+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:04:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 msgr2=0x7f899c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 0x7f899c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89b0109290 tx=0x7f899800b590 comp rx=0 tx=0).stop 2024-09-21T07:04:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 msgr2=0x7f89b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89a0005940 tx=0x7f89a00042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 shutdown_connections 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f899c0b6510 0x7f899c0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89b0109e00 0x7f89b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89b01094b0 0x7f89b0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 --2- 172.21.15.28:0/2170325765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b0103bc0 0x7f89b0075710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 >> 172.21.15.28:0/2170325765 conn(0x7f89b007b910 msgr2=0x7f89b01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 shutdown_connections 2024-09-21T07:04:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:54.162+0000 7f89b68e9640 1 -- 172.21.15.28:0/2170325765 wait complete. 2024-09-21T07:04:54.976 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:04:55.238 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:55.674 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:55 smithi028 ceph-mon[31213]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:55.674 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:55 smithi028 ceph-mon[31213]: pgmap v293: 97 pgs: 97 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-21T07:04:55.674 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:55 smithi028 ceph-mon[31213]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:04:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:55 smithi181 ceph-mon[34686]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:55 smithi181 ceph-mon[34686]: pgmap v293: 97 pgs: 97 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-21T07:04:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:55 smithi181 ceph-mon[34686]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:04:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 -- 172.21.15.28:0/2012379671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 msgr2=0x7f8798104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 --2- 172.21.15.28:0/2012379671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f8798104cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8794009900 tx=0x7f879402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 -- 172.21.15.28:0/2012379671 shutdown_connections 2024-09-21T07:04:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 --2- 172.21.15.28:0/2012379671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879810de70 0x7f8798110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 --2- 172.21.15.28:0/2012379671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87981052f0 0x7f879810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 --2- 172.21.15.28:0/2012379671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f8798104cd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 -- 172.21.15.28:0/2012379671 >> 172.21.15.28:0/2012379671 conn(0x7f8798079770 msgr2=0x7f8798079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 -- 172.21.15.28:0/2012379671 shutdown_connections 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.769+0000 7f879f293640 1 -- 172.21.15.28:0/2012379671 wait complete. 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.770+0000 7f879f293640 1 Processor -- start 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.770+0000 7f879f293640 1 -- start start 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 0x7f879819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f879810de70 0x7f879819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8798113af0 con 0x7f87981048c0 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f8798113970 con 0x7f879810de70 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8798113c70 con 0x7f87981052f0 2024-09-21T07:04:55.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42470/0 (socket says 172.21.15.28:42470) 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 -- 172.21.15.28:0/3044861230 learned_addr learned my addr 172.21.15.28:0/3044861230 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879c82e640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 0x7f879819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d830640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f879810de70 0x7f879819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 -- 172.21.15.28:0/3044861230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 msgr2=0x7f879819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 0x7f879819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 -- 172.21.15.28:0/3044861230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f879810de70 msgr2=0x7f879819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f879810de70 0x7f879819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 -- 172.21.15.28:0/3044861230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87981a04b0 con 0x7f87981048c0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879c82e640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 0x7f879819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879d02f640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8794005940 tx=0x7f87940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879403f030 con 0x7f87981048c0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8794003cb0 con 0x7f87981048c0 2024-09-21T07:04:55.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.771+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87981a0740 con 0x7f87981048c0 2024-09-21T07:04:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.772+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794035070 con 0x7f87981048c0 2024-09-21T07:04:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.772+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87981a6f00 con 0x7f87981048c0 2024-09-21T07:04:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.773+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879806c200 con 0x7f87981048c0 2024-09-21T07:04:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.774+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8794042030 con 0x7f87981048c0 2024-09-21T07:04:55.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.775+0000 7f878e7fc640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 0x7f87840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.775+0000 7f879c82e640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 0x7f87840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.775+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f8794107950 con 0x7f87981048c0 2024-09-21T07:04:55.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.776+0000 7f879c82e640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 0x7f87840b8ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8798100170 tx=0x7f8788005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.780+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87940ce130 con 0x7f87981048c0 2024-09-21T07:04:55.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:55 smithi129 ceph-mon[34863]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:55.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:55 smithi129 ceph-mon[34863]: pgmap v293: 97 pgs: 97 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-21T07:04:55.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:55 smithi129 ceph-mon[34863]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:04:55.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:55.998+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8798108120 con 0x7f87840b65a0 2024-09-21T07:04:56.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.025+0000 7f878e7fc640 1 -- 172.21.15.28:0/3044861230 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8798108120 con 0x7f87840b65a0 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.027+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 msgr2=0x7f87840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.027+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 0x7f87840b8ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8798100170 tx=0x7f8788005e50 comp rx=0 tx=0).stop 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 msgr2=0x7f879819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8794005940 tx=0x7f87940042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 shutdown_connections 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f87840b65a0 0x7f87840b8ab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f879810de70 0x7f879819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87981052f0 0x7f879819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 --2- 172.21.15.28:0/3044861230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87981048c0 0x7f879819a540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 >> 172.21.15.28:0/3044861230 conn(0x7f8798079770 msgr2=0x7f8798107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:56.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 shutdown_connections 2024-09-21T07:04:56.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:56.028+0000 7f879f293640 1 -- 172.21.15.28:0/3044861230 wait complete. 2024-09-21T07:04:56.754 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:56 smithi028 ceph-mon[31213]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:56.758 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:56 smithi129 ceph-mon[34863]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:56.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:56 smithi181 ceph-mon[34686]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:56.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:04:57.041 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:57.441 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:57 smithi028 ceph-mon[31213]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 -- 172.21.15.28:0/3972627923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0140109df0 msgr2=0x7f0140110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 --2- 172.21.15.28:0/3972627923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0140109df0 0x7f0140110620 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0138009ca0 tx=0x7f013802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 -- 172.21.15.28:0/3972627923 shutdown_connections 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 --2- 172.21.15.28:0/3972627923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0140109df0 0x7f0140110620 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 --2- 172.21.15.28:0/3972627923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f01401094a0 0x7f01401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 --2- 172.21.15.28:0/3972627923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0140103b60 0x7f0140103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 -- 172.21.15.28:0/3972627923 >> 172.21.15.28:0/3972627923 conn(0x7f014007b850 msgr2=0x7f014007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 -- 172.21.15.28:0/3972627923 shutdown_connections 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.538+0000 7f014857b640 1 -- 172.21.15.28:0/3972627923 wait complete. 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 Processor -- start 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 -- start start 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 0x7f0140075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0140109df0 0x7f0140076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0140113ab0 con 0x7f01401094a0 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0140113930 con 0x7f0140103b60 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f014857b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0140113c30 con 0x7f0140109df0 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f0145b16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f0145b16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42500/0 (socket says 172.21.15.28:42500) 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f0145b16640 1 -- 172.21.15.28:0/1161822604 learned_addr learned my addr 172.21.15.28:0/1161822604 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.539+0000 7f0146317640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 0x7f0140075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:57.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 -- 172.21.15.28:0/1161822604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0140109df0 msgr2=0x7f0140076190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0140109df0 0x7f0140076190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 -- 172.21.15.28:0/1161822604 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 msgr2=0x7f0140075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 0x7f0140075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 -- 172.21.15.28:0/1161822604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01401a8700 con 0x7f01401094a0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0146317640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 0x7f0140075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f0145b16640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9f0 tx=0x7f013000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000ccc0 con 0x7f01401094a0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01300108e0 con 0x7f01401094a0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130018860 con 0x7f01401094a0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01401a89f0 con 0x7f01401094a0 2024-09-21T07:04:57.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.540+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01401a8ee0 con 0x7f01401094a0 2024-09-21T07:04:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.541+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0140103f70 con 0x7f01401094a0 2024-09-21T07:04:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.543+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0130010430 con 0x7f01401094a0 2024-09-21T07:04:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.544+0000 7f01377fe640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 0x7f012c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.544+0000 7f0146317640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 0x7f012c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.544+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f01300e7c00 con 0x7f01401094a0 2024-09-21T07:04:57.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.544+0000 7f0146317640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 0x7f012c0b8ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0140077160 tx=0x7f013c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:57.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.547+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01300ae3e0 con 0x7f01401094a0 2024-09-21T07:04:57.671 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:57 smithi181 ceph-mon[34686]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:04:57.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.764+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0140063800 con 0x7f012c0b65a0 2024-09-21T07:04:57.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.771+0000 7f01377fe640 1 -- 172.21.15.28:0/1161822604 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0140063800 con 0x7f012c0b65a0 2024-09-21T07:04:57.772 INFO:teuthology.orchestra.run.smithi028.stdout:/volumes/qa/sv_0/c45279c6-013c-477c-8691-c4f512888c6f 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 msgr2=0x7f012c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 0x7f012c0b8ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0140077160 tx=0x7f013c00b390 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 msgr2=0x7f0140075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9f0 tx=0x7f013000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 shutdown_connections 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f012c0b65a0 0x7f012c0b8ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0140109df0 0x7f0140076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01401094a0 0x7f0140075c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 --2- 172.21.15.28:0/1161822604 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0140103b60 0x7f0140075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 >> 172.21.15.28:0/1161822604 conn(0x7f014007b850 msgr2=0x7f01401074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 shutdown_connections 2024-09-21T07:04:57.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:57.773+0000 7f014857b640 1 -- 172.21.15.28:0/1161822604 wait complete. 2024-09-21T07:04:57.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:57 smithi129 ceph-mon[34863]: pgmap v294: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:04:58.455 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:58 smithi028 ceph-mon[31213]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:58.486 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:04:58.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:58 smithi181 ceph-mon[34686]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:58.744 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:58.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:58 smithi129 ceph-mon[34863]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:59.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 -- 172.21.15.28:0/3656592067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc10de60 msgr2=0x7f5bbc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 --2- 172.21.15.28:0/3656592067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc10de60 0x7f5bbc110330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009ca0 tx=0x7f5bb402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 -- 172.21.15.28:0/3656592067 shutdown_connections 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 --2- 172.21.15.28:0/3656592067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc10de60 0x7f5bbc110330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 --2- 172.21.15.28:0/3656592067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc105380 0x7f5bbc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 --2- 172.21.15.28:0/3656592067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 0x7f5bbc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 -- 172.21.15.28:0/3656592067 >> 172.21.15.28:0/3656592067 conn(0x7f5bbc079760 msgr2=0x7f5bbc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 -- 172.21.15.28:0/3656592067 shutdown_connections 2024-09-21T07:04:59.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.253+0000 7f5bc2193640 1 -- 172.21.15.28:0/3656592067 wait complete. 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 Processor -- start 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 -- start start 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 0x7f5bbc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc10de60 0x7f5bbc19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc113aa0 con 0x7f5bbc105380 2024-09-21T07:04:59.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc113920 con 0x7f5bbc104a30 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bc2193640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc113c20 con 0x7f5bbc10de60 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42518/0 (socket says 172.21.15.28:42518) 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bbaffd640 1 -- 172.21.15.28:0/1261126296 learned_addr learned my addr 172.21.15.28:0/1261126296 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.254+0000 7f5bbb7fe640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 0x7f5bbc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbbfff640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc10de60 0x7f5bbc19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 -- 172.21.15.28:0/1261126296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc10de60 msgr2=0x7f5bbc19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc10de60 0x7f5bbc19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 -- 172.21.15.28:0/1261126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 msgr2=0x7f5bbc19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 0x7f5bbc19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 -- 172.21.15.28:0/1261126296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc1a03c0 con 0x7f5bbc105380 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bbaffd640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000d950 tx=0x7f5bb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0017070 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc1a06b0 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bb0009c30 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00047a0 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.255+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc1a6e10 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.257+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bbc06c1f0 con 0x7f5bbc105380 2024-09-21T07:04:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.258+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5bb0004020 con 0x7f5bbc105380 2024-09-21T07:04:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.259+0000 7f5bb8ff9640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 0x7f5ba40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.259+0000 7f5bbb7fe640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 0x7f5ba40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.259+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f5bb00e6fe0 con 0x7f5bbc105380 2024-09-21T07:04:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.259+0000 7f5bbb7fe640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 0x7f5ba40b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06c8f0 tx=0x7f5bac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:59.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.263+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bb0020020 con 0x7f5bbc105380 2024-09-21T07:04:59.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.481+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5bbc063800 con 0x7f5ba40b65a0 2024-09-21T07:04:59.482 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:04:59 smithi028 ceph-mon[31213]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:04:59.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.508+0000 7f5bb8ff9640 1 -- 172.21.15.28:0/1261126296 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5bbc063800 con 0x7f5ba40b65a0 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 msgr2=0x7f5ba40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 0x7f5ba40b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06c8f0 tx=0x7f5bac00b390 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 msgr2=0x7f5bbc19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000d950 tx=0x7f5bb000de10 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 shutdown_connections 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ba40b65a0 0x7f5ba40b8ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bbc10de60 0x7f5bbc19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bbc105380 0x7f5bbc19a9f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 --2- 172.21.15.28:0/1261126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bbc104a30 0x7f5bbc19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 >> 172.21.15.28:0/1261126296 conn(0x7f5bbc079760 msgr2=0x7f5bbc1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 shutdown_connections 2024-09-21T07:04:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:04:59.510+0000 7f5bc2193640 1 -- 172.21.15.28:0/1261126296 wait complete. 2024-09-21T07:04:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:04:59 smithi181 ceph-mon[34686]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:04:59.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:04:59 smithi129 ceph-mon[34863]: pgmap v295: 97 pgs: 97 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:05:00.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:05:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:00.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:00 smithi028 ceph-mon[31213]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:00.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:00 smithi181 ceph-mon[34686]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:00.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:00 smithi129 ceph-mon[34863]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 -- 172.21.15.28:0/2605387092 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 msgr2=0x7f9184103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 --2- 172.21.15.28:0/2605387092 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184103f70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9174009900 tx=0x7f917402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 -- 172.21.15.28:0/2605387092 shutdown_connections 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 --2- 172.21.15.28:0/2605387092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 0x7f9184110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 --2- 172.21.15.28:0/2605387092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 0x7f91841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 --2- 172.21.15.28:0/2605387092 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184103f70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 -- 172.21.15.28:0/2605387092 >> 172.21.15.28:0/2605387092 conn(0x7f918407b850 msgr2=0x7f918407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 -- 172.21.15.28:0/2605387092 shutdown_connections 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 -- 172.21.15.28:0/2605387092 wait complete. 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.005+0000 7f9189cac640 1 Processor -- start 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 -- start start 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 0x7f9184075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 0x7f9184076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9184113ab0 con 0x7f9184103b60 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9184113930 con 0x7f9184109df0 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9189cac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9184113c30 con 0x7f91841094a0 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42536/0 (socket says 172.21.15.28:42536) 2024-09-21T07:05:01.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 -- 172.21.15.28:0/3922646709 learned_addr learned my addr 172.21.15.28:0/3922646709 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9182ffd640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 0x7f9184075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f9183fff640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 0x7f9184076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 -- 172.21.15.28:0/3922646709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 msgr2=0x7f9184075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 0x7f9184075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 -- 172.21.15.28:0/3922646709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 msgr2=0x7f9184076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 0x7f9184076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.006+0000 7f91837fe640 1 -- 172.21.15.28:0/3922646709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91841a87e0 con 0x7f9184103b60 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f91837fe640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9174006010 tx=0x7f91740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917403f030 con 0x7f9184103b60 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91841a8a70 con 0x7f9184103b60 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9174003800 con 0x7f9184103b60 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174035070 con 0x7f9184103b60 2024-09-21T07:05:01.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.007+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91841a8f50 con 0x7f9184103b60 2024-09-21T07:05:01.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.008+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9184103f70 con 0x7f9184103b60 2024-09-21T07:05:01.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.011+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9174003cb0 con 0x7f9184103b60 2024-09-21T07:05:01.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.011+0000 7f9180ff9640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 0x7f916c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:01.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.011+0000 7f9182ffd640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 0x7f916c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:01.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.012+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f9174107f70 con 0x7f9184103b60 2024-09-21T07:05:01.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.012+0000 7f9182ffd640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 0x7f916c0b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9178005fd0 tx=0x7f9178005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:01.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.014+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91740ce850 con 0x7f9184103b60 2024-09-21T07:05:01.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.232+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9184063800 con 0x7f916c0b65a0 2024-09-21T07:05:01.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.238+0000 7f9180ff9640 1 -- 172.21.15.28:0/3922646709 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9184063800 con 0x7f916c0b65a0 2024-09-21T07:05:01.239 INFO:teuthology.orchestra.run.smithi028.stdout:/volumes/qa/sv_1/da8e04a1-d48f-49df-ad7f-1b4c7bfe8732 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 msgr2=0x7f916c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 0x7f916c0b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9178005fd0 tx=0x7f9178005e20 comp rx=0 tx=0).stop 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 msgr2=0x7f9184075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9174006010 tx=0x7f91740042f0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 shutdown_connections 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f916c0b65a0 0x7f916c0b8ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9184109df0 0x7f9184076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91841094a0 0x7f9184075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 --2- 172.21.15.28:0/3922646709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9184103b60 0x7f9184075710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.240+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 >> 172.21.15.28:0/3922646709 conn(0x7f918407b850 msgr2=0x7f91841075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.241+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 shutdown_connections 2024-09-21T07:05:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:01.241+0000 7f9189cac640 1 -- 172.21.15.28:0/3922646709 wait complete. 2024-09-21T07:05:01.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:01 smithi028 ceph-mon[31213]: pgmap v296: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:05:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:01 smithi181 ceph-mon[34686]: pgmap v296: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:05:01.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:01 smithi129 ceph-mon[34863]: pgmap v296: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:05:01.963 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:05:02.222 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:02.679 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:02 smithi028 ceph-mon[31213]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 -- 172.21.15.28:0/3976598762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 msgr2=0x7fef54104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 --2- 172.21.15.28:0/3976598762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef54104e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fef44009900 tx=0x7fef4402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 -- 172.21.15.28:0/3976598762 shutdown_connections 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 --2- 172.21.15.28:0/3976598762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 0x7fef54110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 --2- 172.21.15.28:0/3976598762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 0x7fef5410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 --2- 172.21.15.28:0/3976598762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef54104e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 -- 172.21.15.28:0/3976598762 >> 172.21.15.28:0/3976598762 conn(0x7fef54079760 msgr2=0x7fef54079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 -- 172.21.15.28:0/3976598762 shutdown_connections 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.676+0000 7fef5a72e640 1 -- 172.21.15.28:0/3976598762 wait complete. 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.677+0000 7fef5a72e640 1 Processor -- start 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.677+0000 7fef5a72e640 1 -- start start 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 0x7fef5419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 0x7fef5419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:02.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef54113ac0 con 0x7fef54104a30 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fef54113940 con 0x7fef54105380 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef5a72e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef54113c40 con 0x7fef5410de60 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52940/0 (socket says 172.21.15.28:52940) 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 -- 172.21.15.28:0/1099818717 learned_addr learned my addr 172.21.15.28:0/1099818717 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef58ccb640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 0x7fef5419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef537fe640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 0x7fef5419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 -- 172.21.15.28:0/1099818717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 msgr2=0x7fef5419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 0x7fef5419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 -- 172.21.15.28:0/1099818717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 msgr2=0x7fef5419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 0x7fef5419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 -- 172.21.15.28:0/1099818717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef541a0440 con 0x7fef54104a30 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.678+0000 7fef53fff640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef44032fd0 tx=0x7fef44031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:02.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.679+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4403f030 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.679+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef541a06d0 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.679+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef44004490 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.679+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44035070 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.679+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a6e90 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.680+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5406c1f0 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.681+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fef44042030 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.682+0000 7fef517fa640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 0x7fef3c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.682+0000 7fef537fe640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 0x7fef3c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.682+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fef441079c0 con 0x7fef54104a30 2024-09-21T07:05:02.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.683+0000 7fef537fe640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 0x7fef3c0b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef54102430 tx=0x7fef48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:02.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.686+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef440d2680 con 0x7fef54104a30 2024-09-21T07:05:02.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:02 smithi181 ceph-mon[34686]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:02 smithi129 ceph-mon[34863]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.914+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef54108fd0 con 0x7fef54104a30 2024-09-21T07:05:02.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.914+0000 7fef517fa640 1 -- 172.21.15.28:0/1099818717 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7fef440d75c0 con 0x7fef54104a30 2024-09-21T07:05:02.917 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:02.917 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:05:02.917 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 msgr2=0x7fef3c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 0x7fef3c0b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef54102430 tx=0x7fef48005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 msgr2=0x7fef5419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef44032fd0 tx=0x7fef44031a20 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 shutdown_connections 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fef3c0b65a0 0x7fef3c0b8ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef5410de60 0x7fef5419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.916+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef54105380 0x7fef5419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.917+0000 7fef5a72e640 1 --2- 172.21.15.28:0/1099818717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef54104a30 0x7fef5419a4d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.917+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 >> 172.21.15.28:0/1099818717 conn(0x7fef54079760 msgr2=0x7fef54100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:02.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.917+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 shutdown_connections 2024-09-21T07:05:02.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:02.917+0000 7fef5a72e640 1 -- 172.21.15.28:0/1099818717 wait complete. 2024-09-21T07:05:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:03 smithi028 ceph-mon[31213]: pgmap v297: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:05:03.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:03 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1099818717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:03.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:05:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:03 smithi181 ceph-mon[34686]: pgmap v297: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:05:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:03 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1099818717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:03.855 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:03.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:03 smithi129 ceph-mon[34863]: pgmap v297: 97 pgs: 97 active+clean; 604 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:05:03.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:03 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1099818717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 -- 172.21.15.28:0/2713552130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db41083a0 msgr2=0x7f4db41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 --2- 172.21.15.28:0/2713552130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db41083a0 0x7f4db41087b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009900 tx=0x7f4da802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 -- 172.21.15.28:0/2713552130 shutdown_connections 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 --2- 172.21.15.28:0/2713552130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db4108cf0 0x7f4db410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 --2- 172.21.15.28:0/2713552130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db41083a0 0x7f4db41087b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 --2- 172.21.15.28:0/2713552130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 0x7f4db4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 -- 172.21.15.28:0/2713552130 >> 172.21.15.28:0/2713552130 conn(0x7f4db4079730 msgr2=0x7f4db4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 -- 172.21.15.28:0/2713552130 shutdown_connections 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.319+0000 7f4dbc115640 1 -- 172.21.15.28:0/2713552130 wait complete. 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 Processor -- start 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 -- start start 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 0x7f4db419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db41083a0 0x7f4db419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4112960 con 0x7f4db4108cf0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41127e0 con 0x7f4db4102a60 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dbc115640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4112ae0 con 0x7f4db41083a0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.320+0000 7f4dba6b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52964/0 (socket says 172.21.15.28:52964) 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 -- 172.21.15.28:0/316944664 learned_addr learned my addr 172.21.15.28:0/316944664 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4db9eb1640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 0x7f4db419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4db96b0640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db41083a0 0x7f4db419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 -- 172.21.15.28:0/316944664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db41083a0 msgr2=0x7f4db419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db41083a0 0x7f4db419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 -- 172.21.15.28:0/316944664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 msgr2=0x7f4db419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 0x7f4db419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 -- 172.21.15.28:0/316944664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db41a03f0 con 0x7f4db4108cf0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dba6b2640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00eaa0 tx=0x7f4dac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00cdb0 con 0x7f4db4108cf0 2024-09-21T07:05:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db41a06e0 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dac005020 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0116d0 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.321+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db41a6e40 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.323+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db4102e70 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.324+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4dac004b20 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.325+0000 7f4da6ffd640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 0x7f4da00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.325+0000 7f4db9eb1640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 0x7f4da00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.325+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f4dac0e7540 con 0x7f4db4108cf0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.326+0000 7f4db9eb1640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 0x7f4da00b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.330+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4dac016030 con 0x7f4db4108cf0 2024-09-21T07:05:04.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.524+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4db410b560 con 0x7f4db4108cf0 2024-09-21T07:05:04.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.525+0000 7f4da6ffd640 1 -- 172.21.15.28:0/316944664 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22300 (secure 0 0 0) 0x7f4dac0a7e20 con 0x7f4db4108cf0 2024-09-21T07:05:04.528 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:04.528 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:04:40.762279+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:05:04.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 msgr2=0x7f4da00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:04.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 0x7f4da00b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db0005850 comp rx=0 tx=0).stop 2024-09-21T07:05:04.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 msgr2=0x7f4db419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:04.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00eaa0 tx=0x7f4dac00ef60 comp rx=0 tx=0).stop 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 shutdown_connections 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4da00b65a0 0x7f4da00b8ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4db4108cf0 0x7f4db419fcc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4db41083a0 0x7f4db419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 --2- 172.21.15.28:0/316944664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4db4102a60 0x7f4db419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 >> 172.21.15.28:0/316944664 conn(0x7f4db4079730 msgr2=0x7f4db406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 shutdown_connections 2024-09-21T07:05:04.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:04.528+0000 7f4dbc115640 1 -- 172.21.15.28:0/316944664 wait complete. 2024-09-21T07:05:05.245 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:05:05.246 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:05:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:05.532 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:05 smithi028 ceph-mon[31213]: pgmap v298: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-21T07:05:05.532 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/316944664' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:05 smithi181 ceph-mon[34686]: pgmap v298: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-21T07:05:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:05 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/316944664' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:05.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:05 smithi129 ceph-mon[34863]: pgmap v298: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-21T07:05:05.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:05 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/316944664' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 -- 172.21.15.28:0/1303263188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 msgr2=0x7fab58104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 --2- 172.21.15.28:0/1303263188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab58104e40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab48009900 tx=0x7fab4802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 -- 172.21.15.28:0/1303263188 shutdown_connections 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 --2- 172.21.15.28:0/1303263188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab58110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 --2- 172.21.15.28:0/1303263188 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 --2- 172.21.15.28:0/1303263188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab58104e40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 -- 172.21.15.28:0/1303263188 >> 172.21.15.28:0/1303263188 conn(0x7fab58079790 msgr2=0x7fab58079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 -- 172.21.15.28:0/1303263188 shutdown_connections 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.986+0000 7fab5e543640 1 -- 172.21.15.28:0/1303263188 wait complete. 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.987+0000 7fab5e543640 1 Processor -- start 2024-09-21T07:05:05.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.987+0000 7fab5e543640 1 -- start start 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab581a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab58113b20 con 0x7fab58104a30 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fab581139a0 con 0x7fab58105380 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fab58113ca0 con 0x7fab5810de60 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52974/0 (socket says 172.21.15.28:52974) 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 -- 172.21.15.28:0/1732697602 learned_addr learned my addr 172.21.15.28:0/1732697602 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab577fe640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5cae0640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab581a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 -- 172.21.15.28:0/1732697602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 msgr2=0x7fab581a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab581a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 -- 172.21.15.28:0/1732697602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 msgr2=0x7fab5819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:05.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 -- 172.21.15.28:0/1732697602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab581a2680 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5cae0640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab581a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab577fe640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab57fff640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fab48006010 tx=0x7fab480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4803f030 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab48003800 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab581a2910 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48035070 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.988+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab581a2df0 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.989+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab58104e40 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.991+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fab48003cb0 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.992+0000 7fab557fa640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 0x7fab400b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.992+0000 7fab577fe640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 0x7fab400b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.992+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fab48107ff0 con 0x7fab58104a30 2024-09-21T07:05:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.992+0000 7fab577fe640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 0x7fab400b8ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab5810fbc0 tx=0x7fab4c005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:05.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:05.996+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab480ce810 con 0x7fab58104a30 2024-09-21T07:05:06.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.181+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab58100cf0 con 0x7fab400b65d0 2024-09-21T07:05:06.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.187+0000 7fab557fa640 1 -- 172.21.15.28:0/1732697602 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258865 (secure 0 0 0) 0x7fab58100cf0 con 0x7fab400b65d0 2024-09-21T07:05:06.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:06.192 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-21T07:05:06.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 msgr2=0x7fab400b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 0x7fab400b8ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab5810fbc0 tx=0x7fab4c005d90 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 msgr2=0x7fab5819c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fab48006010 tx=0x7fab480042f0 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 shutdown_connections 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab400b65d0 0x7fab400b8ae0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab5810de60 0x7fab581a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab58105380 0x7fab5819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 --2- 172.21.15.28:0/1732697602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58104a30 0x7fab5819c7d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 >> 172.21.15.28:0/1732697602 conn(0x7fab58079790 msgr2=0x7fab581005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 shutdown_connections 2024-09-21T07:05:06.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:06.190+0000 7fab5e543640 1 -- 172.21.15.28:0/1732697602 wait complete. 2024-09-21T07:05:07.000 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T07:05:04.265480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645152,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":175,"num_read_kb":172,"num_write":272,"num_write_kb":2248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371316,"kb_used_data":9588,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570508,"statfs":{"total":1151940427776,"available":1151560200192,"internally_reserved":0,"allocated":9818112,"data_stored":6421084,"data_compressed":112751,"data_compressed_allocated":143360,"data_compressed_original":1785856,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50766,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":93,"num_read_kb":102,"num_write":48,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072715+0000","last_change":"2024-09-21T07:04:40.072039+0000","last_active":"2024-09-21T07:04:41.072715+0000","last_peered":"2024-09-21T07:04:41.072715+0000","last_clean":"2024-09-21T07:04:41.072715+0000","last_became_active":"2024-09-21T07:04:40.071228+0000","last_became_peered":"2024-09-21T07:04:40.071228+0000","last_unstale":"2024-09-21T07:04:41.072715+0000","last_undegraded":"2024-09-21T07:04:41.072715+0000","last_fullsized":"2024-09-21T07:04:41.072715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:42.645145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074652+0000","last_change":"2024-09-21T07:04:40.062714+0000","last_active":"2024-09-21T07:04:41.074652+0000","last_peered":"2024-09-21T07:04:41.074652+0000","last_clean":"2024-09-21T07:04:41.074652+0000","last_became_active":"2024-09-21T07:04:40.062309+0000","last_became_peered":"2024-09-21T07:04:40.062309+0000","last_unstale":"2024-09-21T07:04:41.074652+0000","last_undegraded":"2024-09-21T07:04:41.074652+0000","last_fullsized":"2024-09-21T07:04:41.074652+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.604991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073470+0000","last_change":"2024-09-21T07:04:40.071023+0000","last_active":"2024-09-21T07:04:41.073470+0000","last_peered":"2024-09-21T07:04:41.073470+0000","last_clean":"2024-09-21T07:04:41.073470+0000","last_became_active":"2024-09-21T07:04:40.069846+0000","last_became_peered":"2024-09-21T07:04:40.069846+0000","last_unstale":"2024-09-21T07:04:41.073470+0000","last_undegraded":"2024-09-21T07:04:41.073470+0000","last_fullsized":"2024-09-21T07:04:41.073470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:45.611132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.059200+0000","last_change":"2024-09-21T07:04:40.058144+0000","last_active":"2024-09-21T07:04:41.059200+0000","last_peered":"2024-09-21T07:04:41.059200+0000","last_clean":"2024-09-21T07:04:41.059200+0000","last_became_active":"2024-09-21T07:04:40.057753+0000","last_became_peered":"2024-09-21T07:04:40.057753+0000","last_unstale":"2024-09-21T07:04:41.059200+0000","last_undegraded":"2024-09-21T07:04:41.059200+0000","last_fullsized":"2024-09-21T07:04:41.059200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:37.578024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072267+0000","last_change":"2024-09-21T07:04:40.068685+0000","last_active":"2024-09-21T07:04:41.072267+0000","last_peered":"2024-09-21T07:04:41.072267+0000","last_clean":"2024-09-21T07:04:41.072267+0000","last_became_active":"2024-09-21T07:04:40.068312+0000","last_became_peered":"2024-09-21T07:04:40.068312+0000","last_unstale":"2024-09-21T07:04:41.072267+0000","last_undegraded":"2024-09-21T07:04:41.072267+0000","last_fullsized":"2024-09-21T07:04:41.072267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:22.049405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071058+0000","last_change":"2024-09-21T07:04:40.076852+0000","last_active":"2024-09-21T07:04:41.071058+0000","last_peered":"2024-09-21T07:04:41.071058+0000","last_clean":"2024-09-21T07:04:41.071058+0000","last_became_active":"2024-09-21T07:04:40.076377+0000","last_became_peered":"2024-09-21T07:04:40.076377+0000","last_unstale":"2024-09-21T07:04:41.071058+0000","last_undegraded":"2024-09-21T07:04:41.071058+0000","last_fullsized":"2024-09-21T07:04:41.071058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:21.776048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073881+0000","last_change":"2024-09-21T07:04:40.075024+0000","last_active":"2024-09-21T07:04:41.073881+0000","last_peered":"2024-09-21T07:04:41.073881+0000","last_clean":"2024-09-21T07:04:41.073881+0000","last_became_active":"2024-09-21T07:04:40.074651+0000","last_became_peered":"2024-09-21T07:04:40.074651+0000","last_unstale":"2024-09-21T07:04:41.073881+0000","last_undegraded":"2024-09-21T07:04:41.073881+0000","last_fullsized":"2024-09-21T07:04:41.073881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:04.184336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071872+0000","last_change":"2024-09-21T07:04:40.067007+0000","last_active":"2024-09-21T07:04:41.071872+0000","last_peered":"2024-09-21T07:04:41.071872+0000","last_clean":"2024-09-21T07:04:41.071872+0000","last_became_active":"2024-09-21T07:04:40.065599+0000","last_became_peered":"2024-09-21T07:04:40.065599+0000","last_unstale":"2024-09-21T07:04:41.071872+0000","last_undegraded":"2024-09-21T07:04:41.071872+0000","last_fullsized":"2024-09-21T07:04:41.071872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:45.868671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077884+0000","last_change":"2024-09-21T07:04:40.079713+0000","last_active":"2024-09-21T07:04:41.077884+0000","last_peered":"2024-09-21T07:04:41.077884+0000","last_clean":"2024-09-21T07:04:41.077884+0000","last_became_active":"2024-09-21T07:04:40.078983+0000","last_became_peered":"2024-09-21T07:04:40.078983+0000","last_unstale":"2024-09-21T07:04:41.077884+0000","last_undegraded":"2024-09-21T07:04:41.077884+0000","last_fullsized":"2024-09-21T07:04:41.077884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:32.077942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072142+0000","last_change":"2024-09-21T07:04:40.078249+0000","last_active":"2024-09-21T07:04:41.072142+0000","last_peered":"2024-09-21T07:04:41.072142+0000","last_clean":"2024-09-21T07:04:41.072142+0000","last_became_active":"2024-09-21T07:04:40.077882+0000","last_became_peered":"2024-09-21T07:04:40.077882+0000","last_unstale":"2024-09-21T07:04:41.072142+0000","last_undegraded":"2024-09-21T07:04:41.072142+0000","last_fullsized":"2024-09-21T07:04:41.072142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:32.360168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074630+0000","last_change":"2024-09-21T07:04:40.070979+0000","last_active":"2024-09-21T07:04:41.074630+0000","last_peered":"2024-09-21T07:04:41.074630+0000","last_clean":"2024-09-21T07:04:41.074630+0000","last_became_active":"2024-09-21T07:04:40.070592+0000","last_became_peered":"2024-09-21T07:04:40.070592+0000","last_unstale":"2024-09-21T07:04:41.074630+0000","last_undegraded":"2024-09-21T07:04:41.074630+0000","last_fullsized":"2024-09-21T07:04:41.074630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:36.224263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058978+0000","last_change":"2024-09-21T07:04:40.069650+0000","last_active":"2024-09-21T07:04:41.058978+0000","last_peered":"2024-09-21T07:04:41.058978+0000","last_clean":"2024-09-21T07:04:41.058978+0000","last_became_active":"2024-09-21T07:04:40.068885+0000","last_became_peered":"2024-09-21T07:04:40.068885+0000","last_unstale":"2024-09-21T07:04:41.058978+0000","last_undegraded":"2024-09-21T07:04:41.058978+0000","last_fullsized":"2024-09-21T07:04:41.058978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.187038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057157+0000","last_change":"2024-09-21T07:04:40.061852+0000","last_active":"2024-09-21T07:04:41.057157+0000","last_peered":"2024-09-21T07:04:41.057157+0000","last_clean":"2024-09-21T07:04:41.057157+0000","last_became_active":"2024-09-21T07:04:40.061490+0000","last_became_peered":"2024-09-21T07:04:40.061490+0000","last_unstale":"2024-09-21T07:04:41.057157+0000","last_undegraded":"2024-09-21T07:04:41.057157+0000","last_fullsized":"2024-09-21T07:04:41.057157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:43.570941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073472+0000","last_change":"2024-09-21T07:04:40.066844+0000","last_active":"2024-09-21T07:04:41.073472+0000","last_peered":"2024-09-21T07:04:41.073472+0000","last_clean":"2024-09-21T07:04:41.073472+0000","last_became_active":"2024-09-21T07:04:40.066472+0000","last_became_peered":"2024-09-21T07:04:40.066472+0000","last_unstale":"2024-09-21T07:04:41.073472+0000","last_undegraded":"2024-09-21T07:04:41.073472+0000","last_fullsized":"2024-09-21T07:04:41.073472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:58.798270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074055+0000","last_change":"2024-09-21T07:04:40.068856+0000","last_active":"2024-09-21T07:04:41.074055+0000","last_peered":"2024-09-21T07:04:41.074055+0000","last_clean":"2024-09-21T07:04:41.074055+0000","last_became_active":"2024-09-21T07:04:40.068483+0000","last_became_peered":"2024-09-21T07:04:40.068483+0000","last_unstale":"2024-09-21T07:04:41.074055+0000","last_undegraded":"2024-09-21T07:04:41.074055+0000","last_fullsized":"2024-09-21T07:04:41.074055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076457+0000","last_change":"2024-09-21T07:04:40.072565+0000","last_active":"2024-09-21T07:04:41.076457+0000","last_peered":"2024-09-21T07:04:41.076457+0000","last_clean":"2024-09-21T07:04:41.076457+0000","last_became_active":"2024-09-21T07:04:40.071464+0000","last_became_peered":"2024-09-21T07:04:40.071464+0000","last_unstale":"2024-09-21T07:04:41.076457+0000","last_undegraded":"2024-09-21T07:04:41.076457+0000","last_fullsized":"2024-09-21T07:04:41.076457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.821627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072823+0000","last_change":"2024-09-21T07:04:40.071563+0000","last_active":"2024-09-21T07:04:41.072823+0000","last_peered":"2024-09-21T07:04:41.072823+0000","last_clean":"2024-09-21T07:04:41.072823+0000","last_became_active":"2024-09-21T07:04:40.070763+0000","last_became_peered":"2024-09-21T07:04:40.070763+0000","last_unstale":"2024-09-21T07:04:41.072823+0000","last_undegraded":"2024-09-21T07:04:41.072823+0000","last_fullsized":"2024-09-21T07:04:41.072823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:01.856385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072047+0000","last_change":"2024-09-21T07:04:40.071528+0000","last_active":"2024-09-21T07:04:41.072047+0000","last_peered":"2024-09-21T07:04:41.072047+0000","last_clean":"2024-09-21T07:04:41.072047+0000","last_became_active":"2024-09-21T07:04:40.071146+0000","last_became_peered":"2024-09-21T07:04:40.071146+0000","last_unstale":"2024-09-21T07:04:41.072047+0000","last_undegraded":"2024-09-21T07:04:41.072047+0000","last_fullsized":"2024-09-21T07:04:41.072047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:30.032226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072882+0000","last_change":"2024-09-21T07:04:40.066043+0000","last_active":"2024-09-21T07:04:41.072882+0000","last_peered":"2024-09-21T07:04:41.072882+0000","last_clean":"2024-09-21T07:04:41.072882+0000","last_became_active":"2024-09-21T07:04:40.065651+0000","last_became_peered":"2024-09-21T07:04:40.065651+0000","last_unstale":"2024-09-21T07:04:41.072882+0000","last_undegraded":"2024-09-21T07:04:41.072882+0000","last_fullsized":"2024-09-21T07:04:41.072882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:26.450331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071463+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:04:41.071463+0000","last_peered":"2024-09-21T07:04:41.071463+0000","last_clean":"2024-09-21T07:04:41.071463+0000","last_became_active":"2024-09-21T07:04:40.076129+0000","last_became_peered":"2024-09-21T07:04:40.076129+0000","last_unstale":"2024-09-21T07:04:41.071463+0000","last_undegraded":"2024-09-21T07:04:41.071463+0000","last_fullsized":"2024-09-21T07:04:41.071463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:14.019420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057338+0000","last_change":"2024-09-21T07:04:40.072299+0000","last_active":"2024-09-21T07:04:41.057338+0000","last_peered":"2024-09-21T07:04:41.057338+0000","last_clean":"2024-09-21T07:04:41.057338+0000","last_became_active":"2024-09-21T07:04:40.071883+0000","last_became_peered":"2024-09-21T07:04:40.071883+0000","last_unstale":"2024-09-21T07:04:41.057338+0000","last_undegraded":"2024-09-21T07:04:41.057338+0000","last_fullsized":"2024-09-21T07:04:41.057338+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:20.065717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076866+0000","last_change":"2024-09-21T07:04:40.072016+0000","last_active":"2024-09-21T07:04:41.076866+0000","last_peered":"2024-09-21T07:04:41.076866+0000","last_clean":"2024-09-21T07:04:41.076866+0000","last_became_active":"2024-09-21T07:04:40.071543+0000","last_became_peered":"2024-09-21T07:04:40.071543+0000","last_unstale":"2024-09-21T07:04:41.076866+0000","last_undegraded":"2024-09-21T07:04:41.076866+0000","last_fullsized":"2024-09-21T07:04:41.076866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:28.427766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071827+0000","last_change":"2024-09-21T07:04:40.075354+0000","last_active":"2024-09-21T07:04:41.071827+0000","last_peered":"2024-09-21T07:04:41.071827+0000","last_clean":"2024-09-21T07:04:41.071827+0000","last_became_active":"2024-09-21T07:04:40.075037+0000","last_became_peered":"2024-09-21T07:04:40.075037+0000","last_unstale":"2024-09-21T07:04:41.071827+0000","last_undegraded":"2024-09-21T07:04:41.071827+0000","last_fullsized":"2024-09-21T07:04:41.071827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.473774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058389+0000","last_change":"2024-09-21T07:04:40.066252+0000","last_active":"2024-09-21T07:04:41.058389+0000","last_peered":"2024-09-21T07:04:41.058389+0000","last_clean":"2024-09-21T07:04:41.058389+0000","last_became_active":"2024-09-21T07:04:40.065907+0000","last_became_peered":"2024-09-21T07:04:40.065907+0000","last_unstale":"2024-09-21T07:04:41.058389+0000","last_undegraded":"2024-09-21T07:04:41.058389+0000","last_fullsized":"2024-09-21T07:04:41.058389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:21.807697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072772+0000","last_change":"2024-09-21T07:04:40.076476+0000","last_active":"2024-09-21T07:04:41.072772+0000","last_peered":"2024-09-21T07:04:41.072772+0000","last_clean":"2024-09-21T07:04:41.072772+0000","last_became_active":"2024-09-21T07:04:40.075983+0000","last_became_peered":"2024-09-21T07:04:40.075983+0000","last_unstale":"2024-09-21T07:04:41.072772+0000","last_undegraded":"2024-09-21T07:04:41.072772+0000","last_fullsized":"2024-09-21T07:04:41.072772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:23.583516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074710+0000","last_change":"2024-09-21T07:04:40.069865+0000","last_active":"2024-09-21T07:04:41.074710+0000","last_peered":"2024-09-21T07:04:41.074710+0000","last_clean":"2024-09-21T07:04:41.074710+0000","last_became_active":"2024-09-21T07:04:40.069456+0000","last_became_peered":"2024-09-21T07:04:40.069456+0000","last_unstale":"2024-09-21T07:04:41.074710+0000","last_undegraded":"2024-09-21T07:04:41.074710+0000","last_fullsized":"2024-09-21T07:04:41.074710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072314+0000","last_change":"2024-09-21T07:04:40.065527+0000","last_active":"2024-09-21T07:04:41.072314+0000","last_peered":"2024-09-21T07:04:41.072314+0000","last_clean":"2024-09-21T07:04:41.072314+0000","last_became_active":"2024-09-21T07:04:40.065187+0000","last_became_peered":"2024-09-21T07:04:40.065187+0000","last_unstale":"2024-09-21T07:04:41.072314+0000","last_undegraded":"2024-09-21T07:04:41.072314+0000","last_fullsized":"2024-09-21T07:04:41.072314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.615948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057027+0000","last_change":"2024-09-21T07:04:40.074025+0000","last_active":"2024-09-21T07:04:41.057027+0000","last_peered":"2024-09-21T07:04:41.057027+0000","last_clean":"2024-09-21T07:04:41.057027+0000","last_became_active":"2024-09-21T07:04:40.073669+0000","last_became_peered":"2024-09-21T07:04:40.073669+0000","last_unstale":"2024-09-21T07:04:41.057027+0000","last_undegraded":"2024-09-21T07:04:41.057027+0000","last_fullsized":"2024-09-21T07:04:41.057027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:22.863209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074738+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:04:41.074738+0000","last_peered":"2024-09-21T07:04:41.074738+0000","last_clean":"2024-09-21T07:04:41.074738+0000","last_became_active":"2024-09-21T07:04:40.069645+0000","last_became_peered":"2024-09-21T07:04:40.069645+0000","last_unstale":"2024-09-21T07:04:41.074738+0000","last_undegraded":"2024-09-21T07:04:41.074738+0000","last_fullsized":"2024-09-21T07:04:41.074738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:03.108375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072569+0000","last_change":"2024-09-21T07:04:40.065818+0000","last_active":"2024-09-21T07:04:41.072569+0000","last_peered":"2024-09-21T07:04:41.072569+0000","last_clean":"2024-09-21T07:04:41.072569+0000","last_became_active":"2024-09-21T07:04:40.065422+0000","last_became_peered":"2024-09-21T07:04:40.065422+0000","last_unstale":"2024-09-21T07:04:41.072569+0000","last_undegraded":"2024-09-21T07:04:41.072569+0000","last_fullsized":"2024-09-21T07:04:41.072569+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:28.597574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073446+0000","last_change":"2024-09-21T07:04:40.064223+0000","last_active":"2024-09-21T07:04:41.073446+0000","last_peered":"2024-09-21T07:04:41.073446+0000","last_clean":"2024-09-21T07:04:41.073446+0000","last_became_active":"2024-09-21T07:04:40.057620+0000","last_became_peered":"2024-09-21T07:04:40.057620+0000","last_unstale":"2024-09-21T07:04:41.073446+0000","last_undegraded":"2024-09-21T07:04:41.073446+0000","last_fullsized":"2024-09-21T07:04:41.073446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:25.518187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072281+0000","last_change":"2024-09-21T07:04:40.070105+0000","last_active":"2024-09-21T07:04:41.072281+0000","last_peered":"2024-09-21T07:04:41.072281+0000","last_clean":"2024-09-21T07:04:41.072281+0000","last_became_active":"2024-09-21T07:04:40.068920+0000","last_became_peered":"2024-09-21T07:04:40.068920+0000","last_unstale":"2024-09-21T07:04:41.072281+0000","last_undegraded":"2024-09-21T07:04:41.072281+0000","last_fullsized":"2024-09-21T07:04:41.072281+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:51.847607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071580+0000","last_change":"2024-09-21T07:04:40.064852+0000","last_active":"2024-09-21T07:04:41.071580+0000","last_peered":"2024-09-21T07:04:41.071580+0000","last_clean":"2024-09-21T07:04:41.071580+0000","last_became_active":"2024-09-21T07:04:40.064476+0000","last_became_peered":"2024-09-21T07:04:40.064476+0000","last_unstale":"2024-09-21T07:04:41.071580+0000","last_undegraded":"2024-09-21T07:04:41.071580+0000","last_fullsized":"2024-09-21T07:04:41.071580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:45.579783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:02.378194+0000","last_change":"2024-09-21T07:04:38.052529+0000","last_active":"2024-09-21T07:05:02.378194+0000","last_peered":"2024-09-21T07:05:02.378194+0000","last_clean":"2024-09-21T07:05:02.378194+0000","last_became_active":"2024-09-21T07:04:38.052117+0000","last_became_peered":"2024-09-21T07:04:38.052117+0000","last_unstale":"2024-09-21T07:05:02.378194+0000","last_undegraded":"2024-09-21T07:05:02.378194+0000","last_fullsized":"2024-09-21T07:05:02.378194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:06.454006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058350+0000","last_change":"2024-09-21T07:04:40.077259+0000","last_active":"2024-09-21T07:04:41.058350+0000","last_peered":"2024-09-21T07:04:41.058350+0000","last_clean":"2024-09-21T07:04:41.058350+0000","last_became_active":"2024-09-21T07:04:40.076911+0000","last_became_peered":"2024-09-21T07:04:40.076911+0000","last_unstale":"2024-09-21T07:04:41.058350+0000","last_undegraded":"2024-09-21T07:04:41.058350+0000","last_fullsized":"2024-09-21T07:04:41.058350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:08.410875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.350139+0000","last_change":"2024-09-21T07:04:38.052545+0000","last_active":"2024-09-21T07:04:49.350139+0000","last_peered":"2024-09-21T07:04:49.350139+0000","last_clean":"2024-09-21T07:04:49.350139+0000","last_became_active":"2024-09-21T07:04:38.052115+0000","last_became_peered":"2024-09-21T07:04:38.052115+0000","last_unstale":"2024-09-21T07:04:49.350139+0000","last_undegraded":"2024-09-21T07:04:49.350139+0000","last_fullsized":"2024-09-21T07:04:49.350139+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.021727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351436+0000","last_change":"2024-09-21T07:04:38.050595+0000","last_active":"2024-09-21T07:04:49.351436+0000","last_peered":"2024-09-21T07:04:49.351436+0000","last_clean":"2024-09-21T07:04:49.351436+0000","last_became_active":"2024-09-21T07:04:38.050206+0000","last_became_peered":"2024-09-21T07:04:38.050206+0000","last_unstale":"2024-09-21T07:04:49.351436+0000","last_undegraded":"2024-09-21T07:04:49.351436+0000","last_fullsized":"2024-09-21T07:04:49.351436+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:37.746521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072110+0000","last_change":"2024-09-21T07:04:40.075300+0000","last_active":"2024-09-21T07:04:41.072110+0000","last_peered":"2024-09-21T07:04:41.072110+0000","last_clean":"2024-09-21T07:04:41.072110+0000","last_became_active":"2024-09-21T07:04:40.074959+0000","last_became_peered":"2024-09-21T07:04:40.074959+0000","last_unstale":"2024-09-21T07:04:41.072110+0000","last_undegraded":"2024-09-21T07:04:41.072110+0000","last_fullsized":"2024-09-21T07:04:41.072110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:42.935716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058670+0000","last_change":"2024-09-21T07:04:38.056440+0000","last_active":"2024-09-21T07:04:41.058670+0000","last_peered":"2024-09-21T07:04:41.058670+0000","last_clean":"2024-09-21T07:04:41.058670+0000","last_became_active":"2024-09-21T07:04:38.055917+0000","last_became_peered":"2024-09-21T07:04:38.055917+0000","last_unstale":"2024-09-21T07:04:41.058670+0000","last_undegraded":"2024-09-21T07:04:41.058670+0000","last_fullsized":"2024-09-21T07:04:41.058670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:54.090537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071760+0000","last_change":"2024-09-21T07:04:40.061602+0000","last_active":"2024-09-21T07:04:41.071760+0000","last_peered":"2024-09-21T07:04:41.071760+0000","last_clean":"2024-09-21T07:04:41.071760+0000","last_became_active":"2024-09-21T07:04:40.061209+0000","last_became_peered":"2024-09-21T07:04:40.061209+0000","last_unstale":"2024-09-21T07:04:41.071760+0000","last_undegraded":"2024-09-21T07:04:41.071760+0000","last_fullsized":"2024-09-21T07:04:41.071760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:31.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'3","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:02.377470+0000","last_change":"2024-09-21T07:04:38.053231+0000","last_active":"2024-09-21T07:05:02.377470+0000","last_peered":"2024-09-21T07:05:02.377470+0000","last_clean":"2024-09-21T07:05:02.377470+0000","last_became_active":"2024-09-21T07:04:38.052824+0000","last_became_peered":"2024-09-21T07:04:38.052824+0000","last_unstale":"2024-09-21T07:05:02.377470+0000","last_undegraded":"2024-09-21T07:05:02.377470+0000","last_fullsized":"2024-09-21T07:05:02.377470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:44.168096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077089+0000","last_change":"2024-09-21T07:04:40.070107+0000","last_active":"2024-09-21T07:04:41.077089+0000","last_peered":"2024-09-21T07:04:41.077089+0000","last_clean":"2024-09-21T07:04:41.077089+0000","last_became_active":"2024-09-21T07:04:40.069649+0000","last_became_peered":"2024-09-21T07:04:40.069649+0000","last_unstale":"2024-09-21T07:04:41.077089+0000","last_undegraded":"2024-09-21T07:04:41.077089+0000","last_fullsized":"2024-09-21T07:04:41.077089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.824442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.346083+0000","last_change":"2024-09-21T07:04:38.049413+0000","last_active":"2024-09-21T07:04:48.346083+0000","last_peered":"2024-09-21T07:04:48.346083+0000","last_clean":"2024-09-21T07:04:48.346083+0000","last_became_active":"2024-09-21T07:04:38.049034+0000","last_became_peered":"2024-09-21T07:04:38.049034+0000","last_unstale":"2024-09-21T07:04:48.346083+0000","last_undegraded":"2024-09-21T07:04:48.346083+0000","last_fullsized":"2024-09-21T07:04:48.346083+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.866543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075162+0000","last_change":"2024-09-21T07:04:40.075411+0000","last_active":"2024-09-21T07:04:41.075162+0000","last_peered":"2024-09-21T07:04:41.075162+0000","last_clean":"2024-09-21T07:04:41.075162+0000","last_became_active":"2024-09-21T07:04:40.074410+0000","last_became_peered":"2024-09-21T07:04:40.074410+0000","last_unstale":"2024-09-21T07:04:41.075162+0000","last_undegraded":"2024-09-21T07:04:41.075162+0000","last_fullsized":"2024-09-21T07:04:41.075162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:15.685477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343450+0000","last_change":"2024-09-21T07:04:38.138349+0000","last_active":"2024-09-21T07:04:48.343450+0000","last_peered":"2024-09-21T07:04:48.343450+0000","last_clean":"2024-09-21T07:04:48.343450+0000","last_became_active":"2024-09-21T07:04:38.137934+0000","last_became_peered":"2024-09-21T07:04:38.137934+0000","last_unstale":"2024-09-21T07:04:48.343450+0000","last_undegraded":"2024-09-21T07:04:48.343450+0000","last_fullsized":"2024-09-21T07:04:48.343450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.963760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077120+0000","last_change":"2024-09-21T07:04:40.076072+0000","last_active":"2024-09-21T07:04:41.077120+0000","last_peered":"2024-09-21T07:04:41.077120+0000","last_clean":"2024-09-21T07:04:41.077120+0000","last_became_active":"2024-09-21T07:04:40.075637+0000","last_became_peered":"2024-09-21T07:04:40.075637+0000","last_unstale":"2024-09-21T07:04:41.077120+0000","last_undegraded":"2024-09-21T07:04:41.077120+0000","last_fullsized":"2024-09-21T07:04:41.077120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:52.272797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'22","reported_seq":74,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:03.379636+0000","last_change":"2024-09-21T07:04:38.052777+0000","last_active":"2024-09-21T07:05:03.379636+0000","last_peered":"2024-09-21T07:05:03.379636+0000","last_clean":"2024-09-21T07:05:03.379636+0000","last_became_active":"2024-09-21T07:04:38.052319+0000","last_became_peered":"2024-09-21T07:04:38.052319+0000","last_unstale":"2024-09-21T07:05:03.379636+0000","last_undegraded":"2024-09-21T07:05:03.379636+0000","last_fullsized":"2024-09-21T07:05:03.379636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:26.124318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":65,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074549+0000","last_change":"2024-09-21T07:04:40.073693+0000","last_active":"2024-09-21T07:04:41.074549+0000","last_peered":"2024-09-21T07:04:41.074549+0000","last_clean":"2024-09-21T07:04:41.074549+0000","last_became_active":"2024-09-21T07:04:40.073362+0000","last_became_peered":"2024-09-21T07:04:40.073362+0000","last_unstale":"2024-09-21T07:04:41.074549+0000","last_undegraded":"2024-09-21T07:04:41.074549+0000","last_fullsized":"2024-09-21T07:04:41.074549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:47.193733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'6","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.353012+0000","last_change":"2024-09-21T07:04:38.052881+0000","last_active":"2024-09-21T07:04:49.353012+0000","last_peered":"2024-09-21T07:04:49.353012+0000","last_clean":"2024-09-21T07:04:49.353012+0000","last_became_active":"2024-09-21T07:04:38.052499+0000","last_became_peered":"2024-09-21T07:04:38.052499+0000","last_unstale":"2024-09-21T07:04:49.353012+0000","last_undegraded":"2024-09-21T07:04:49.353012+0000","last_fullsized":"2024-09-21T07:04:49.353012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.871624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.056818+0000","last_change":"2024-09-21T07:04:40.070165+0000","last_active":"2024-09-21T07:04:41.056818+0000","last_peered":"2024-09-21T07:04:41.056818+0000","last_clean":"2024-09-21T07:04:41.056818+0000","last_became_active":"2024-09-21T07:04:40.068422+0000","last_became_peered":"2024-09-21T07:04:40.068422+0000","last_unstale":"2024-09-21T07:04:41.056818+0000","last_undegraded":"2024-09-21T07:04:41.056818+0000","last_fullsized":"2024-09-21T07:04:41.056818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:09.593392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345508+0000","last_change":"2024-09-21T07:04:38.053713+0000","last_active":"2024-09-21T07:04:48.345508+0000","last_peered":"2024-09-21T07:04:48.345508+0000","last_clean":"2024-09-21T07:04:48.345508+0000","last_became_active":"2024-09-21T07:04:38.053283+0000","last_became_peered":"2024-09-21T07:04:38.053283+0000","last_unstale":"2024-09-21T07:04:48.345508+0000","last_undegraded":"2024-09-21T07:04:48.345508+0000","last_fullsized":"2024-09-21T07:04:48.345508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:53.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074279+0000","last_change":"2024-09-21T07:04:40.080396+0000","last_active":"2024-09-21T07:04:41.074279+0000","last_peered":"2024-09-21T07:04:41.074279+0000","last_clean":"2024-09-21T07:04:41.074279+0000","last_became_active":"2024-09-21T07:04:40.080040+0000","last_became_peered":"2024-09-21T07:04:40.080040+0000","last_unstale":"2024-09-21T07:04:41.074279+0000","last_undegraded":"2024-09-21T07:04:41.074279+0000","last_fullsized":"2024-09-21T07:04:41.074279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:26.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'3","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:57.373012+0000","last_change":"2024-09-21T07:04:38.051776+0000","last_active":"2024-09-21T07:04:57.373012+0000","last_peered":"2024-09-21T07:04:57.373012+0000","last_clean":"2024-09-21T07:04:57.373012+0000","last_became_active":"2024-09-21T07:04:38.048551+0000","last_became_peered":"2024-09-21T07:04:38.048551+0000","last_unstale":"2024-09-21T07:04:57.373012+0000","last_undegraded":"2024-09-21T07:04:57.373012+0000","last_fullsized":"2024-09-21T07:04:57.373012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.640949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073395+0000","last_change":"2024-09-21T07:04:40.066595+0000","last_active":"2024-09-21T07:04:41.073395+0000","last_peered":"2024-09-21T07:04:41.073395+0000","last_clean":"2024-09-21T07:04:41.073395+0000","last_became_active":"2024-09-21T07:04:40.063872+0000","last_became_peered":"2024-09-21T07:04:40.063872+0000","last_unstale":"2024-09-21T07:04:41.073395+0000","last_undegraded":"2024-09-21T07:04:41.073395+0000","last_fullsized":"2024-09-21T07:04:41.073395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:37.820834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'15","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352950+0000","last_change":"2024-09-21T07:04:38.138472+0000","last_active":"2024-09-21T07:04:49.352950+0000","last_peered":"2024-09-21T07:04:49.352950+0000","last_clean":"2024-09-21T07:04:49.352950+0000","last_became_active":"2024-09-21T07:04:38.138095+0000","last_became_peered":"2024-09-21T07:04:38.138095+0000","last_unstale":"2024-09-21T07:04:49.352950+0000","last_undegraded":"2024-09-21T07:04:49.352950+0000","last_fullsized":"2024-09-21T07:04:49.352950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:50.789021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058640+0000","last_change":"2024-09-21T07:04:40.076508+0000","last_active":"2024-09-21T07:04:41.058640+0000","last_peered":"2024-09-21T07:04:41.058640+0000","last_clean":"2024-09-21T07:04:41.058640+0000","last_became_active":"2024-09-21T07:04:40.076115+0000","last_became_peered":"2024-09-21T07:04:40.076115+0000","last_unstale":"2024-09-21T07:04:41.058640+0000","last_undegraded":"2024-09-21T07:04:41.058640+0000","last_fullsized":"2024-09-21T07:04:41.058640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:19.803762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:50.355370+0000","last_change":"2024-09-21T07:04:38.056502+0000","last_active":"2024-09-21T07:04:50.355370+0000","last_peered":"2024-09-21T07:04:50.355370+0000","last_clean":"2024-09-21T07:04:50.355370+0000","last_became_active":"2024-09-21T07:04:38.056146+0000","last_became_peered":"2024-09-21T07:04:38.056146+0000","last_unstale":"2024-09-21T07:04:50.355370+0000","last_undegraded":"2024-09-21T07:04:50.355370+0000","last_fullsized":"2024-09-21T07:04:50.355370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072078+0000","last_change":"2024-09-21T07:04:40.076494+0000","last_active":"2024-09-21T07:04:41.072078+0000","last_peered":"2024-09-21T07:04:41.072078+0000","last_clean":"2024-09-21T07:04:41.072078+0000","last_became_active":"2024-09-21T07:04:40.076156+0000","last_became_peered":"2024-09-21T07:04:40.076156+0000","last_unstale":"2024-09-21T07:04:41.072078+0000","last_undegraded":"2024-09-21T07:04:41.072078+0000","last_fullsized":"2024-09-21T07:04:41.072078+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:07.264957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076756+0000","last_change":"2024-09-21T07:04:38.051857+0000","last_active":"2024-09-21T07:04:41.076756+0000","last_peered":"2024-09-21T07:04:41.076756+0000","last_clean":"2024-09-21T07:04:41.076756+0000","last_became_active":"2024-09-21T07:04:38.051364+0000","last_became_peered":"2024-09-21T07:04:38.051364+0000","last_unstale":"2024-09-21T07:04:41.076756+0000","last_undegraded":"2024-09-21T07:04:41.076756+0000","last_fullsized":"2024-09-21T07:04:41.076756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:48.718078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074474+0000","last_change":"2024-09-21T07:04:40.075163+0000","last_active":"2024-09-21T07:04:41.074474+0000","last_peered":"2024-09-21T07:04:41.074474+0000","last_clean":"2024-09-21T07:04:41.074474+0000","last_became_active":"2024-09-21T07:04:40.074784+0000","last_became_peered":"2024-09-21T07:04:40.074784+0000","last_unstale":"2024-09-21T07:04:41.074474+0000","last_undegraded":"2024-09-21T07:04:41.074474+0000","last_fullsized":"2024-09-21T07:04:41.074474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:40.334326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.079239+0000","last_change":"2024-09-21T07:04:38.051940+0000","last_active":"2024-09-21T07:04:41.079239+0000","last_peered":"2024-09-21T07:04:41.079239+0000","last_clean":"2024-09-21T07:04:41.079239+0000","last_became_active":"2024-09-21T07:04:38.051300+0000","last_became_peered":"2024-09-21T07:04:38.051300+0000","last_unstale":"2024-09-21T07:04:41.079239+0000","last_undegraded":"2024-09-21T07:04:41.079239+0000","last_fullsized":"2024-09-21T07:04:41.079239+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:36.703119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.920730+0000","last_change":"2024-09-21T07:04:40.067171+0000","last_active":"2024-09-21T07:04:41.920730+0000","last_peered":"2024-09-21T07:04:41.920730+0000","last_clean":"2024-09-21T07:04:41.920730+0000","last_became_active":"2024-09-21T07:04:40.066801+0000","last_became_peered":"2024-09-21T07:04:40.066801+0000","last_unstale":"2024-09-21T07:04:41.920730+0000","last_undegraded":"2024-09-21T07:04:41.920730+0000","last_fullsized":"2024-09-21T07:04:41.920730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:30.885860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352620+0000","last_change":"2024-09-21T07:04:38.138427+0000","last_active":"2024-09-21T07:04:49.352620+0000","last_peered":"2024-09-21T07:04:49.352620+0000","last_clean":"2024-09-21T07:04:49.352620+0000","last_became_active":"2024-09-21T07:04:38.137983+0000","last_became_peered":"2024-09-21T07:04:38.137983+0000","last_unstale":"2024-09-21T07:04:49.352620+0000","last_undegraded":"2024-09-21T07:04:49.352620+0000","last_fullsized":"2024-09-21T07:04:49.352620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:43.544784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074729+0000","last_change":"2024-09-21T07:04:40.074114+0000","last_active":"2024-09-21T07:04:41.074729+0000","last_peered":"2024-09-21T07:04:41.074729+0000","last_clean":"2024-09-21T07:04:41.074729+0000","last_became_active":"2024-09-21T07:04:40.073736+0000","last_became_peered":"2024-09-21T07:04:40.073736+0000","last_unstale":"2024-09-21T07:04:41.074729+0000","last_undegraded":"2024-09-21T07:04:41.074729+0000","last_fullsized":"2024-09-21T07:04:41.074729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:42.735634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":93,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073747+0000","last_change":"2024-09-21T07:03:25.075453+0000","last_active":"2024-09-21T07:04:41.073747+0000","last_peered":"2024-09-21T07:04:41.073747+0000","last_clean":"2024-09-21T07:04:41.073747+0000","last_became_active":"2024-09-21T07:03:25.069192+0000","last_became_peered":"2024-09-21T07:03:25.069192+0000","last_unstale":"2024-09-21T07:04:41.073747+0000","last_undegraded":"2024-09-21T07:04:41.073747+0000","last_fullsized":"2024-09-21T07:04:41.073747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_clean_scrub_stamp":"2024-09-21T06:59:59.393354+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:56.048484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'3","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:50.356131+0000","last_change":"2024-09-21T07:04:38.051627+0000","last_active":"2024-09-21T07:04:50.356131+0000","last_peered":"2024-09-21T07:04:50.356131+0000","last_clean":"2024-09-21T07:04:50.356131+0000","last_became_active":"2024-09-21T07:04:38.050547+0000","last_became_peered":"2024-09-21T07:04:38.050547+0000","last_unstale":"2024-09-21T07:04:50.356131+0000","last_undegraded":"2024-09-21T07:04:50.356131+0000","last_fullsized":"2024-09-21T07:04:50.356131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:11.607629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073518+0000","last_change":"2024-09-21T07:04:40.065627+0000","last_active":"2024-09-21T07:04:41.073518+0000","last_peered":"2024-09-21T07:04:41.073518+0000","last_clean":"2024-09-21T07:04:41.073518+0000","last_became_active":"2024-09-21T07:04:40.065265+0000","last_became_peered":"2024-09-21T07:04:40.065265+0000","last_unstale":"2024-09-21T07:04:41.073518+0000","last_undegraded":"2024-09-21T07:04:41.073518+0000","last_fullsized":"2024-09-21T07:04:41.073518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:01.950229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351430+0000","last_change":"2024-09-21T07:04:38.052441+0000","last_active":"2024-09-21T07:04:49.351430+0000","last_peered":"2024-09-21T07:04:49.351430+0000","last_clean":"2024-09-21T07:04:49.351430+0000","last_became_active":"2024-09-21T07:04:38.052075+0000","last_became_peered":"2024-09-21T07:04:38.052075+0000","last_unstale":"2024-09-21T07:04:49.351430+0000","last_undegraded":"2024-09-21T07:04:49.351430+0000","last_fullsized":"2024-09-21T07:04:49.351430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.649120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.056828+0000","last_change":"2024-09-21T07:04:40.066421+0000","last_active":"2024-09-21T07:04:41.056828+0000","last_peered":"2024-09-21T07:04:41.056828+0000","last_clean":"2024-09-21T07:04:41.056828+0000","last_became_active":"2024-09-21T07:04:40.066049+0000","last_became_peered":"2024-09-21T07:04:40.066049+0000","last_unstale":"2024-09-21T07:04:41.056828+0000","last_undegraded":"2024-09-21T07:04:41.056828+0000","last_fullsized":"2024-09-21T07:04:41.056828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:03.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'4","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:59.374894+0000","last_change":"2024-09-21T07:04:38.137231+0000","last_active":"2024-09-21T07:04:59.374894+0000","last_peered":"2024-09-21T07:04:59.374894+0000","last_clean":"2024-09-21T07:04:59.374894+0000","last_became_active":"2024-09-21T07:04:38.136854+0000","last_became_peered":"2024-09-21T07:04:38.136854+0000","last_unstale":"2024-09-21T07:04:59.374894+0000","last_undegraded":"2024-09-21T07:04:59.374894+0000","last_fullsized":"2024-09-21T07:04:59.374894+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:58.386863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058056+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:04:41.058056+0000","last_peered":"2024-09-21T07:04:41.058056+0000","last_clean":"2024-09-21T07:04:41.058056+0000","last_became_active":"2024-09-21T07:04:40.076144+0000","last_became_peered":"2024-09-21T07:04:40.076144+0000","last_unstale":"2024-09-21T07:04:41.058056+0000","last_undegraded":"2024-09-21T07:04:41.058056+0000","last_fullsized":"2024-09-21T07:04:41.058056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:51.520464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.920705+0000","last_change":"2024-09-21T07:04:38.048223+0000","last_active":"2024-09-21T07:04:41.920705+0000","last_peered":"2024-09-21T07:04:41.920705+0000","last_clean":"2024-09-21T07:04:41.920705+0000","last_became_active":"2024-09-21T07:04:38.047761+0000","last_became_peered":"2024-09-21T07:04:38.047761+0000","last_unstale":"2024-09-21T07:04:41.920705+0000","last_undegraded":"2024-09-21T07:04:41.920705+0000","last_fullsized":"2024-09-21T07:04:41.920705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:50.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071211+0000","last_change":"2024-09-21T07:04:40.076961+0000","last_active":"2024-09-21T07:04:41.071211+0000","last_peered":"2024-09-21T07:04:41.071211+0000","last_clean":"2024-09-21T07:04:41.071211+0000","last_became_active":"2024-09-21T07:04:40.076572+0000","last_became_peered":"2024-09-21T07:04:40.076572+0000","last_unstale":"2024-09-21T07:04:41.071211+0000","last_undegraded":"2024-09-21T07:04:41.071211+0000","last_fullsized":"2024-09-21T07:04:41.071211+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.688173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071625+0000","last_change":"2024-09-21T07:04:38.138897+0000","last_active":"2024-09-21T07:04:41.071625+0000","last_peered":"2024-09-21T07:04:41.071625+0000","last_clean":"2024-09-21T07:04:41.071625+0000","last_became_active":"2024-09-21T07:04:38.138510+0000","last_became_peered":"2024-09-21T07:04:38.138510+0000","last_unstale":"2024-09-21T07:04:41.071625+0000","last_undegraded":"2024-09-21T07:04:41.071625+0000","last_fullsized":"2024-09-21T07:04:41.071625+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:27.244819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:44.012020+0000","last_change":"2024-09-21T07:04:40.064091+0000","last_active":"2024-09-21T07:04:44.012020+0000","last_peered":"2024-09-21T07:04:44.012020+0000","last_clean":"2024-09-21T07:04:44.012020+0000","last_became_active":"2024-09-21T07:04:40.063704+0000","last_became_peered":"2024-09-21T07:04:40.063704+0000","last_unstale":"2024-09-21T07:04:44.012020+0000","last_undegraded":"2024-09-21T07:04:44.012020+0000","last_fullsized":"2024-09-21T07:04:44.012020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:35.838486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343943+0000","last_change":"2024-09-21T07:04:38.138326+0000","last_active":"2024-09-21T07:04:48.343943+0000","last_peered":"2024-09-21T07:04:48.343943+0000","last_clean":"2024-09-21T07:04:48.343943+0000","last_became_active":"2024-09-21T07:04:38.137933+0000","last_became_peered":"2024-09-21T07:04:38.137933+0000","last_unstale":"2024-09-21T07:04:48.343943+0000","last_undegraded":"2024-09-21T07:04:48.343943+0000","last_fullsized":"2024-09-21T07:04:48.343943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:32.569458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057183+0000","last_change":"2024-09-21T07:04:40.058661+0000","last_active":"2024-09-21T07:04:41.057183+0000","last_peered":"2024-09-21T07:04:41.057183+0000","last_clean":"2024-09-21T07:04:41.057183+0000","last_became_active":"2024-09-21T07:04:40.058198+0000","last_became_peered":"2024-09-21T07:04:40.058198+0000","last_unstale":"2024-09-21T07:04:41.057183+0000","last_undegraded":"2024-09-21T07:04:41.057183+0000","last_fullsized":"2024-09-21T07:04:41.057183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:17.876087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:00.070366+0000","last_change":"2024-09-21T07:04:38.048742+0000","last_active":"2024-09-21T07:05:00.070366+0000","last_peered":"2024-09-21T07:05:00.070366+0000","last_clean":"2024-09-21T07:05:00.070366+0000","last_became_active":"2024-09-21T07:04:38.048360+0000","last_became_peered":"2024-09-21T07:04:38.048360+0000","last_unstale":"2024-09-21T07:05:00.070366+0000","last_undegraded":"2024-09-21T07:05:00.070366+0000","last_fullsized":"2024-09-21T07:05:00.070366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:00.977592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075596+0000","last_change":"2024-09-21T07:04:40.076235+0000","last_active":"2024-09-21T07:04:41.075596+0000","last_peered":"2024-09-21T07:04:41.075596+0000","last_clean":"2024-09-21T07:04:41.075596+0000","last_became_active":"2024-09-21T07:04:40.075888+0000","last_became_peered":"2024-09-21T07:04:40.075888+0000","last_unstale":"2024-09-21T07:04:41.075596+0000","last_undegraded":"2024-09-21T07:04:41.075596+0000","last_fullsized":"2024-09-21T07:04:41.075596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:21.277910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343674+0000","last_change":"2024-09-21T07:04:38.054023+0000","last_active":"2024-09-21T07:04:48.343674+0000","last_peered":"2024-09-21T07:04:48.343674+0000","last_clean":"2024-09-21T07:04:48.343674+0000","last_became_active":"2024-09-21T07:04:38.053621+0000","last_became_peered":"2024-09-21T07:04:38.053621+0000","last_unstale":"2024-09-21T07:04:48.343674+0000","last_undegraded":"2024-09-21T07:04:48.343674+0000","last_fullsized":"2024-09-21T07:04:48.343674+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:10.732857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074757+0000","last_change":"2024-09-21T07:04:40.068522+0000","last_active":"2024-09-21T07:04:41.074757+0000","last_peered":"2024-09-21T07:04:41.074757+0000","last_clean":"2024-09-21T07:04:41.074757+0000","last_became_active":"2024-09-21T07:04:40.068119+0000","last_became_peered":"2024-09-21T07:04:40.068119+0000","last_unstale":"2024-09-21T07:04:41.074757+0000","last_undegraded":"2024-09-21T07:04:41.074757+0000","last_fullsized":"2024-09-21T07:04:41.074757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:43.963965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345656+0000","last_change":"2024-09-21T07:04:38.138336+0000","last_active":"2024-09-21T07:04:48.345656+0000","last_peered":"2024-09-21T07:04:48.345656+0000","last_clean":"2024-09-21T07:04:48.345656+0000","last_became_active":"2024-09-21T07:04:38.138002+0000","last_became_peered":"2024-09-21T07:04:38.138002+0000","last_unstale":"2024-09-21T07:04:48.345656+0000","last_undegraded":"2024-09-21T07:04:48.345656+0000","last_fullsized":"2024-09-21T07:04:48.345656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.594369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073805+0000","last_change":"2024-09-21T07:04:40.073385+0000","last_active":"2024-09-21T07:04:41.073805+0000","last_peered":"2024-09-21T07:04:41.073805+0000","last_clean":"2024-09-21T07:04:41.073805+0000","last_became_active":"2024-09-21T07:04:40.072962+0000","last_became_peered":"2024-09-21T07:04:40.072962+0000","last_unstale":"2024-09-21T07:04:41.073805+0000","last_undegraded":"2024-09-21T07:04:41.073805+0000","last_fullsized":"2024-09-21T07:04:41.073805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:14.656729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343212+0000","last_change":"2024-09-21T07:04:38.048141+0000","last_active":"2024-09-21T07:04:48.343212+0000","last_peered":"2024-09-21T07:04:48.343212+0000","last_clean":"2024-09-21T07:04:48.343212+0000","last_became_active":"2024-09-21T07:04:38.047717+0000","last_became_peered":"2024-09-21T07:04:38.047717+0000","last_unstale":"2024-09-21T07:04:48.343212+0000","last_undegraded":"2024-09-21T07:04:48.343212+0000","last_fullsized":"2024-09-21T07:04:48.343212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:55.920716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072528+0000","last_change":"2024-09-21T07:04:40.069741+0000","last_active":"2024-09-21T07:04:41.072528+0000","last_peered":"2024-09-21T07:04:41.072528+0000","last_clean":"2024-09-21T07:04:41.072528+0000","last_became_active":"2024-09-21T07:04:40.069256+0000","last_became_peered":"2024-09-21T07:04:40.069256+0000","last_unstale":"2024-09-21T07:04:41.072528+0000","last_undegraded":"2024-09-21T07:04:41.072528+0000","last_fullsized":"2024-09-21T07:04:41.072528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:50.484011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075145+0000","last_change":"2024-09-21T07:04:38.050014+0000","last_active":"2024-09-21T07:04:41.075145+0000","last_peered":"2024-09-21T07:04:41.075145+0000","last_clean":"2024-09-21T07:04:41.075145+0000","last_became_active":"2024-09-21T07:04:38.049277+0000","last_became_peered":"2024-09-21T07:04:38.049277+0000","last_unstale":"2024-09-21T07:04:41.075145+0000","last_undegraded":"2024-09-21T07:04:41.075145+0000","last_fullsized":"2024-09-21T07:04:41.075145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:43.365126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072512+0000","last_change":"2024-09-21T07:04:40.065254+0000","last_active":"2024-09-21T07:04:41.072512+0000","last_peered":"2024-09-21T07:04:41.072512+0000","last_clean":"2024-09-21T07:04:41.072512+0000","last_became_active":"2024-09-21T07:04:40.064660+0000","last_became_peered":"2024-09-21T07:04:40.064660+0000","last_unstale":"2024-09-21T07:04:41.072512+0000","last_undegraded":"2024-09-21T07:04:41.072512+0000","last_fullsized":"2024-09-21T07:04:41.072512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:05.731169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345683+0000","last_change":"2024-09-21T07:04:38.055323+0000","last_active":"2024-09-21T07:04:48.345683+0000","last_peered":"2024-09-21T07:04:48.345683+0000","last_clean":"2024-09-21T07:04:48.345683+0000","last_became_active":"2024-09-21T07:04:38.054953+0000","last_became_peered":"2024-09-21T07:04:38.054953+0000","last_unstale":"2024-09-21T07:04:48.345683+0000","last_undegraded":"2024-09-21T07:04:48.345683+0000","last_fullsized":"2024-09-21T07:04:48.345683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:47.009187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074054+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:04:41.074054+0000","last_peered":"2024-09-21T07:04:41.074054+0000","last_clean":"2024-09-21T07:04:41.074054+0000","last_became_active":"2024-09-21T07:04:40.069662+0000","last_became_peered":"2024-09-21T07:04:40.069662+0000","last_unstale":"2024-09-21T07:04:41.074054+0000","last_undegraded":"2024-09-21T07:04:41.074054+0000","last_fullsized":"2024-09-21T07:04:41.074054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:44.556304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058303+0000","last_change":"2024-09-21T07:04:40.079299+0000","last_active":"2024-09-21T07:04:41.058303+0000","last_peered":"2024-09-21T07:04:41.058303+0000","last_clean":"2024-09-21T07:04:41.058303+0000","last_became_active":"2024-09-21T07:04:40.078909+0000","last_became_peered":"2024-09-21T07:04:40.078909+0000","last_unstale":"2024-09-21T07:04:41.058303+0000","last_undegraded":"2024-09-21T07:04:41.058303+0000","last_fullsized":"2024-09-21T07:04:41.058303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:37.600505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.080762+0000","last_change":"2024-09-21T07:04:38.055743+0000","last_active":"2024-09-21T07:04:41.080762+0000","last_peered":"2024-09-21T07:04:41.080762+0000","last_clean":"2024-09-21T07:04:41.080762+0000","last_became_active":"2024-09-21T07:04:38.055344+0000","last_became_peered":"2024-09-21T07:04:38.055344+0000","last_unstale":"2024-09-21T07:04:41.080762+0000","last_undegraded":"2024-09-21T07:04:41.080762+0000","last_fullsized":"2024-09-21T07:04:41.080762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:32.610947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077113+0000","last_change":"2024-09-21T07:04:40.069789+0000","last_active":"2024-09-21T07:04:41.077113+0000","last_peered":"2024-09-21T07:04:41.077113+0000","last_clean":"2024-09-21T07:04:41.077113+0000","last_became_active":"2024-09-21T07:04:40.069399+0000","last_became_peered":"2024-09-21T07:04:40.069399+0000","last_unstale":"2024-09-21T07:04:41.077113+0000","last_undegraded":"2024-09-21T07:04:41.077113+0000","last_fullsized":"2024-09-21T07:04:41.077113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:15.300569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351198+0000","last_change":"2024-09-21T07:04:38.049466+0000","last_active":"2024-09-21T07:04:49.351198+0000","last_peered":"2024-09-21T07:04:49.351198+0000","last_clean":"2024-09-21T07:04:49.351198+0000","last_became_active":"2024-09-21T07:04:38.049067+0000","last_became_peered":"2024-09-21T07:04:38.049067+0000","last_unstale":"2024-09-21T07:04:49.351198+0000","last_undegraded":"2024-09-21T07:04:49.351198+0000","last_fullsized":"2024-09-21T07:04:49.351198+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.514610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075109+0000","last_change":"2024-09-21T07:04:40.072590+0000","last_active":"2024-09-21T07:04:41.075109+0000","last_peered":"2024-09-21T07:04:41.075109+0000","last_clean":"2024-09-21T07:04:41.075109+0000","last_became_active":"2024-09-21T07:04:40.071776+0000","last_became_peered":"2024-09-21T07:04:40.071776+0000","last_unstale":"2024-09-21T07:04:41.075109+0000","last_undegraded":"2024-09-21T07:04:41.075109+0000","last_fullsized":"2024-09-21T07:04:41.075109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:41.742797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.079632+0000","last_change":"2024-09-21T07:04:38.137558+0000","last_active":"2024-09-21T07:04:41.079632+0000","last_peered":"2024-09-21T07:04:41.079632+0000","last_clean":"2024-09-21T07:04:41.079632+0000","last_became_active":"2024-09-21T07:04:38.137173+0000","last_became_peered":"2024-09-21T07:04:38.137173+0000","last_unstale":"2024-09-21T07:04:41.079632+0000","last_undegraded":"2024-09-21T07:04:41.079632+0000","last_fullsized":"2024-09-21T07:04:41.079632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:18.624886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074099+0000","last_change":"2024-09-21T07:04:40.069596+0000","last_active":"2024-09-21T07:04:41.074099+0000","last_peered":"2024-09-21T07:04:41.074099+0000","last_clean":"2024-09-21T07:04:41.074099+0000","last_became_active":"2024-09-21T07:04:40.069095+0000","last_became_peered":"2024-09-21T07:04:40.069095+0000","last_unstale":"2024-09-21T07:04:41.074099+0000","last_undegraded":"2024-09-21T07:04:41.074099+0000","last_fullsized":"2024-09-21T07:04:41.074099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.139930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'9","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352968+0000","last_change":"2024-09-21T07:04:38.052552+0000","last_active":"2024-09-21T07:04:49.352968+0000","last_peered":"2024-09-21T07:04:49.352968+0000","last_clean":"2024-09-21T07:04:49.352968+0000","last_became_active":"2024-09-21T07:04:38.052074+0000","last_became_peered":"2024-09-21T07:04:38.052074+0000","last_unstale":"2024-09-21T07:04:49.352968+0000","last_undegraded":"2024-09-21T07:04:49.352968+0000","last_fullsized":"2024-09-21T07:04:49.352968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:59.280299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54550,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":99,"num_read_kb":108,"num_write":147,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":137110,"data_compressed":3782,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":249413,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841553,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":778240,"data_stored":376596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037783,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1019017,"data_compressed":38214,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":376832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397536,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":376752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561062,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":968291,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":376221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":967975,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":376658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":798720,"data_stored":376532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":428304,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":400414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":24400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":52290,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52518,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:05:07.004 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:05:07.267 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:07.688 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:07 smithi028 ceph-mon[31213]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:07.689 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:07 smithi028 ceph-mon[31213]: pgmap v299: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T07:05:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:07 smithi181 ceph-mon[34686]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:07 smithi181 ceph-mon[34686]: pgmap v299: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.777+0000 7fc56e6a6640 1 -- 172.21.15.28:0/1456223597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568103b60 msgr2=0x7fc568103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.777+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/1456223597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568103b60 0x7fc568103f70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc558009900 tx=0x7fc55802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 -- 172.21.15.28:0/1456223597 shutdown_connections 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/1456223597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc568109df0 0x7fc568110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/1456223597 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5681094a0 0x7fc5681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/1456223597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568103b60 0x7fc568103f70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 -- 172.21.15.28:0/1456223597 >> 172.21.15.28:0/1456223597 conn(0x7fc56807b850 msgr2=0x7fc56807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 -- 172.21.15.28:0/1456223597 shutdown_connections 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 -- 172.21.15.28:0/1456223597 wait complete. 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.778+0000 7fc56e6a6640 1 Processor -- start 2024-09-21T07:05:07.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 -- start start 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc568103b60 0x7fc56819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5681094a0 0x7fc56819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc568113ab0 con 0x7fc568109df0 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc568113930 con 0x7fc568103b60 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56e6a6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc568113c30 con 0x7fc5681094a0 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56cc43640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56cc43640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52994/0 (socket says 172.21.15.28:52994) 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc56cc43640 1 -- 172.21.15.28:0/3480471235 learned_addr learned my addr 172.21.15.28:0/3480471235 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc5677fe640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5681094a0 0x7fc56819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.779+0000 7fc567fff640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc568103b60 0x7fc56819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 -- 172.21.15.28:0/3480471235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5681094a0 msgr2=0x7fc56819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:07.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5681094a0 0x7fc56819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 -- 172.21.15.28:0/3480471235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc568103b60 msgr2=0x7fc56819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc568103b60 0x7fc56819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 -- 172.21.15.28:0/3480471235 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5681a0410 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56cc43640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc56000eaa0 tx=0x7fc56000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56000cdb0 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc560005020 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5681a0700 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5600116d0 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.780+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681a6e60 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.781+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc568103f70 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.784+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc5600051d0 con 0x7fc568109df0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.784+0000 7fc5657fa640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 0x7fc5500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.785+0000 7fc567fff640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 0x7fc5500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:07.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.785+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fc5600e7800 con 0x7fc568109df0 2024-09-21T07:05:07.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.785+0000 7fc567fff640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 0x7fc5500b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc558031440 tx=0x7fc558009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:07.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.788+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc560016030 con 0x7fc568109df0 2024-09-21T07:05:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:07 smithi129 ceph-mon[34863]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:07 smithi129 ceph-mon[34863]: pgmap v299: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-21T07:05:07.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.973+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc568063800 con 0x7fc5500b65a0 2024-09-21T07:05:07.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.979+0000 7fc5657fa640 1 -- 172.21.15.28:0/3480471235 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258882 (secure 0 0 0) 0x7fc568063800 con 0x7fc5500b65a0 2024-09-21T07:05:07.983 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-21T07:05:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 msgr2=0x7fc5500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 0x7fc5500b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc558031440 tx=0x7fc558009560 comp rx=0 tx=0).stop 2024-09-21T07:05:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 msgr2=0x7fc56819fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc56000eaa0 tx=0x7fc56000ef60 comp rx=0 tx=0).stop 2024-09-21T07:05:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 shutdown_connections 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc5500b65a0 0x7fc5500b8ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc568109df0 0x7fc56819fce0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5681094a0 0x7fc56819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 --2- 172.21.15.28:0/3480471235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc568103b60 0x7fc56819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 >> 172.21.15.28:0/3480471235 conn(0x7fc56807b850 msgr2=0x7fc568107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 shutdown_connections 2024-09-21T07:05:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:07.983+0000 7fc56e6a6640 1 -- 172.21.15.28:0/3480471235 wait complete. 2024-09-21T07:05:08.744 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:08 smithi028 ceph-mon[31213]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:08.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:08 smithi181 ceph-mon[34686]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:08.778 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T07:05:06.266071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645152,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":177,"num_write":272,"num_write_kb":2248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371340,"kb_used_data":9612,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570484,"statfs":{"total":1151940427776,"available":1151560175616,"internally_reserved":0,"allocated":9842688,"data_stored":6447624,"data_compressed":114642,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50184,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":90,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003425"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072715+0000","last_change":"2024-09-21T07:04:40.072039+0000","last_active":"2024-09-21T07:04:41.072715+0000","last_peered":"2024-09-21T07:04:41.072715+0000","last_clean":"2024-09-21T07:04:41.072715+0000","last_became_active":"2024-09-21T07:04:40.071228+0000","last_became_peered":"2024-09-21T07:04:40.071228+0000","last_unstale":"2024-09-21T07:04:41.072715+0000","last_undegraded":"2024-09-21T07:04:41.072715+0000","last_fullsized":"2024-09-21T07:04:41.072715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:42.645145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074652+0000","last_change":"2024-09-21T07:04:40.062714+0000","last_active":"2024-09-21T07:04:41.074652+0000","last_peered":"2024-09-21T07:04:41.074652+0000","last_clean":"2024-09-21T07:04:41.074652+0000","last_became_active":"2024-09-21T07:04:40.062309+0000","last_became_peered":"2024-09-21T07:04:40.062309+0000","last_unstale":"2024-09-21T07:04:41.074652+0000","last_undegraded":"2024-09-21T07:04:41.074652+0000","last_fullsized":"2024-09-21T07:04:41.074652+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.604991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073470+0000","last_change":"2024-09-21T07:04:40.071023+0000","last_active":"2024-09-21T07:04:41.073470+0000","last_peered":"2024-09-21T07:04:41.073470+0000","last_clean":"2024-09-21T07:04:41.073470+0000","last_became_active":"2024-09-21T07:04:40.069846+0000","last_became_peered":"2024-09-21T07:04:40.069846+0000","last_unstale":"2024-09-21T07:04:41.073470+0000","last_undegraded":"2024-09-21T07:04:41.073470+0000","last_fullsized":"2024-09-21T07:04:41.073470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:45.611132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.059200+0000","last_change":"2024-09-21T07:04:40.058144+0000","last_active":"2024-09-21T07:04:41.059200+0000","last_peered":"2024-09-21T07:04:41.059200+0000","last_clean":"2024-09-21T07:04:41.059200+0000","last_became_active":"2024-09-21T07:04:40.057753+0000","last_became_peered":"2024-09-21T07:04:40.057753+0000","last_unstale":"2024-09-21T07:04:41.059200+0000","last_undegraded":"2024-09-21T07:04:41.059200+0000","last_fullsized":"2024-09-21T07:04:41.059200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:37.578024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072267+0000","last_change":"2024-09-21T07:04:40.068685+0000","last_active":"2024-09-21T07:04:41.072267+0000","last_peered":"2024-09-21T07:04:41.072267+0000","last_clean":"2024-09-21T07:04:41.072267+0000","last_became_active":"2024-09-21T07:04:40.068312+0000","last_became_peered":"2024-09-21T07:04:40.068312+0000","last_unstale":"2024-09-21T07:04:41.072267+0000","last_undegraded":"2024-09-21T07:04:41.072267+0000","last_fullsized":"2024-09-21T07:04:41.072267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:22.049405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071058+0000","last_change":"2024-09-21T07:04:40.076852+0000","last_active":"2024-09-21T07:04:41.071058+0000","last_peered":"2024-09-21T07:04:41.071058+0000","last_clean":"2024-09-21T07:04:41.071058+0000","last_became_active":"2024-09-21T07:04:40.076377+0000","last_became_peered":"2024-09-21T07:04:40.076377+0000","last_unstale":"2024-09-21T07:04:41.071058+0000","last_undegraded":"2024-09-21T07:04:41.071058+0000","last_fullsized":"2024-09-21T07:04:41.071058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:21.776048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073881+0000","last_change":"2024-09-21T07:04:40.075024+0000","last_active":"2024-09-21T07:04:41.073881+0000","last_peered":"2024-09-21T07:04:41.073881+0000","last_clean":"2024-09-21T07:04:41.073881+0000","last_became_active":"2024-09-21T07:04:40.074651+0000","last_became_peered":"2024-09-21T07:04:40.074651+0000","last_unstale":"2024-09-21T07:04:41.073881+0000","last_undegraded":"2024-09-21T07:04:41.073881+0000","last_fullsized":"2024-09-21T07:04:41.073881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:04.184336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071872+0000","last_change":"2024-09-21T07:04:40.067007+0000","last_active":"2024-09-21T07:04:41.071872+0000","last_peered":"2024-09-21T07:04:41.071872+0000","last_clean":"2024-09-21T07:04:41.071872+0000","last_became_active":"2024-09-21T07:04:40.065599+0000","last_became_peered":"2024-09-21T07:04:40.065599+0000","last_unstale":"2024-09-21T07:04:41.071872+0000","last_undegraded":"2024-09-21T07:04:41.071872+0000","last_fullsized":"2024-09-21T07:04:41.071872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:45.868671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077884+0000","last_change":"2024-09-21T07:04:40.079713+0000","last_active":"2024-09-21T07:04:41.077884+0000","last_peered":"2024-09-21T07:04:41.077884+0000","last_clean":"2024-09-21T07:04:41.077884+0000","last_became_active":"2024-09-21T07:04:40.078983+0000","last_became_peered":"2024-09-21T07:04:40.078983+0000","last_unstale":"2024-09-21T07:04:41.077884+0000","last_undegraded":"2024-09-21T07:04:41.077884+0000","last_fullsized":"2024-09-21T07:04:41.077884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:32.077942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072142+0000","last_change":"2024-09-21T07:04:40.078249+0000","last_active":"2024-09-21T07:04:41.072142+0000","last_peered":"2024-09-21T07:04:41.072142+0000","last_clean":"2024-09-21T07:04:41.072142+0000","last_became_active":"2024-09-21T07:04:40.077882+0000","last_became_peered":"2024-09-21T07:04:40.077882+0000","last_unstale":"2024-09-21T07:04:41.072142+0000","last_undegraded":"2024-09-21T07:04:41.072142+0000","last_fullsized":"2024-09-21T07:04:41.072142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:32.360168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074630+0000","last_change":"2024-09-21T07:04:40.070979+0000","last_active":"2024-09-21T07:04:41.074630+0000","last_peered":"2024-09-21T07:04:41.074630+0000","last_clean":"2024-09-21T07:04:41.074630+0000","last_became_active":"2024-09-21T07:04:40.070592+0000","last_became_peered":"2024-09-21T07:04:40.070592+0000","last_unstale":"2024-09-21T07:04:41.074630+0000","last_undegraded":"2024-09-21T07:04:41.074630+0000","last_fullsized":"2024-09-21T07:04:41.074630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:36.224263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058978+0000","last_change":"2024-09-21T07:04:40.069650+0000","last_active":"2024-09-21T07:04:41.058978+0000","last_peered":"2024-09-21T07:04:41.058978+0000","last_clean":"2024-09-21T07:04:41.058978+0000","last_became_active":"2024-09-21T07:04:40.068885+0000","last_became_peered":"2024-09-21T07:04:40.068885+0000","last_unstale":"2024-09-21T07:04:41.058978+0000","last_undegraded":"2024-09-21T07:04:41.058978+0000","last_fullsized":"2024-09-21T07:04:41.058978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.187038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057157+0000","last_change":"2024-09-21T07:04:40.061852+0000","last_active":"2024-09-21T07:04:41.057157+0000","last_peered":"2024-09-21T07:04:41.057157+0000","last_clean":"2024-09-21T07:04:41.057157+0000","last_became_active":"2024-09-21T07:04:40.061490+0000","last_became_peered":"2024-09-21T07:04:40.061490+0000","last_unstale":"2024-09-21T07:04:41.057157+0000","last_undegraded":"2024-09-21T07:04:41.057157+0000","last_fullsized":"2024-09-21T07:04:41.057157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:43.570941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073472+0000","last_change":"2024-09-21T07:04:40.066844+0000","last_active":"2024-09-21T07:04:41.073472+0000","last_peered":"2024-09-21T07:04:41.073472+0000","last_clean":"2024-09-21T07:04:41.073472+0000","last_became_active":"2024-09-21T07:04:40.066472+0000","last_became_peered":"2024-09-21T07:04:40.066472+0000","last_unstale":"2024-09-21T07:04:41.073472+0000","last_undegraded":"2024-09-21T07:04:41.073472+0000","last_fullsized":"2024-09-21T07:04:41.073472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:58.798270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074055+0000","last_change":"2024-09-21T07:04:40.068856+0000","last_active":"2024-09-21T07:04:41.074055+0000","last_peered":"2024-09-21T07:04:41.074055+0000","last_clean":"2024-09-21T07:04:41.074055+0000","last_became_active":"2024-09-21T07:04:40.068483+0000","last_became_peered":"2024-09-21T07:04:40.068483+0000","last_unstale":"2024-09-21T07:04:41.074055+0000","last_undegraded":"2024-09-21T07:04:41.074055+0000","last_fullsized":"2024-09-21T07:04:41.074055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076457+0000","last_change":"2024-09-21T07:04:40.072565+0000","last_active":"2024-09-21T07:04:41.076457+0000","last_peered":"2024-09-21T07:04:41.076457+0000","last_clean":"2024-09-21T07:04:41.076457+0000","last_became_active":"2024-09-21T07:04:40.071464+0000","last_became_peered":"2024-09-21T07:04:40.071464+0000","last_unstale":"2024-09-21T07:04:41.076457+0000","last_undegraded":"2024-09-21T07:04:41.076457+0000","last_fullsized":"2024-09-21T07:04:41.076457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.821627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072823+0000","last_change":"2024-09-21T07:04:40.071563+0000","last_active":"2024-09-21T07:04:41.072823+0000","last_peered":"2024-09-21T07:04:41.072823+0000","last_clean":"2024-09-21T07:04:41.072823+0000","last_became_active":"2024-09-21T07:04:40.070763+0000","last_became_peered":"2024-09-21T07:04:40.070763+0000","last_unstale":"2024-09-21T07:04:41.072823+0000","last_undegraded":"2024-09-21T07:04:41.072823+0000","last_fullsized":"2024-09-21T07:04:41.072823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:01.856385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072047+0000","last_change":"2024-09-21T07:04:40.071528+0000","last_active":"2024-09-21T07:04:41.072047+0000","last_peered":"2024-09-21T07:04:41.072047+0000","last_clean":"2024-09-21T07:04:41.072047+0000","last_became_active":"2024-09-21T07:04:40.071146+0000","last_became_peered":"2024-09-21T07:04:40.071146+0000","last_unstale":"2024-09-21T07:04:41.072047+0000","last_undegraded":"2024-09-21T07:04:41.072047+0000","last_fullsized":"2024-09-21T07:04:41.072047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:30.032226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072882+0000","last_change":"2024-09-21T07:04:40.066043+0000","last_active":"2024-09-21T07:04:41.072882+0000","last_peered":"2024-09-21T07:04:41.072882+0000","last_clean":"2024-09-21T07:04:41.072882+0000","last_became_active":"2024-09-21T07:04:40.065651+0000","last_became_peered":"2024-09-21T07:04:40.065651+0000","last_unstale":"2024-09-21T07:04:41.072882+0000","last_undegraded":"2024-09-21T07:04:41.072882+0000","last_fullsized":"2024-09-21T07:04:41.072882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:26.450331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071463+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:04:41.071463+0000","last_peered":"2024-09-21T07:04:41.071463+0000","last_clean":"2024-09-21T07:04:41.071463+0000","last_became_active":"2024-09-21T07:04:40.076129+0000","last_became_peered":"2024-09-21T07:04:40.076129+0000","last_unstale":"2024-09-21T07:04:41.071463+0000","last_undegraded":"2024-09-21T07:04:41.071463+0000","last_fullsized":"2024-09-21T07:04:41.071463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:14.019420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057338+0000","last_change":"2024-09-21T07:04:40.072299+0000","last_active":"2024-09-21T07:04:41.057338+0000","last_peered":"2024-09-21T07:04:41.057338+0000","last_clean":"2024-09-21T07:04:41.057338+0000","last_became_active":"2024-09-21T07:04:40.071883+0000","last_became_peered":"2024-09-21T07:04:40.071883+0000","last_unstale":"2024-09-21T07:04:41.057338+0000","last_undegraded":"2024-09-21T07:04:41.057338+0000","last_fullsized":"2024-09-21T07:04:41.057338+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:20.065717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076866+0000","last_change":"2024-09-21T07:04:40.072016+0000","last_active":"2024-09-21T07:04:41.076866+0000","last_peered":"2024-09-21T07:04:41.076866+0000","last_clean":"2024-09-21T07:04:41.076866+0000","last_became_active":"2024-09-21T07:04:40.071543+0000","last_became_peered":"2024-09-21T07:04:40.071543+0000","last_unstale":"2024-09-21T07:04:41.076866+0000","last_undegraded":"2024-09-21T07:04:41.076866+0000","last_fullsized":"2024-09-21T07:04:41.076866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:28.427766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071827+0000","last_change":"2024-09-21T07:04:40.075354+0000","last_active":"2024-09-21T07:04:41.071827+0000","last_peered":"2024-09-21T07:04:41.071827+0000","last_clean":"2024-09-21T07:04:41.071827+0000","last_became_active":"2024-09-21T07:04:40.075037+0000","last_became_peered":"2024-09-21T07:04:40.075037+0000","last_unstale":"2024-09-21T07:04:41.071827+0000","last_undegraded":"2024-09-21T07:04:41.071827+0000","last_fullsized":"2024-09-21T07:04:41.071827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.473774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058389+0000","last_change":"2024-09-21T07:04:40.066252+0000","last_active":"2024-09-21T07:04:41.058389+0000","last_peered":"2024-09-21T07:04:41.058389+0000","last_clean":"2024-09-21T07:04:41.058389+0000","last_became_active":"2024-09-21T07:04:40.065907+0000","last_became_peered":"2024-09-21T07:04:40.065907+0000","last_unstale":"2024-09-21T07:04:41.058389+0000","last_undegraded":"2024-09-21T07:04:41.058389+0000","last_fullsized":"2024-09-21T07:04:41.058389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:21.807697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072772+0000","last_change":"2024-09-21T07:04:40.076476+0000","last_active":"2024-09-21T07:04:41.072772+0000","last_peered":"2024-09-21T07:04:41.072772+0000","last_clean":"2024-09-21T07:04:41.072772+0000","last_became_active":"2024-09-21T07:04:40.075983+0000","last_became_peered":"2024-09-21T07:04:40.075983+0000","last_unstale":"2024-09-21T07:04:41.072772+0000","last_undegraded":"2024-09-21T07:04:41.072772+0000","last_fullsized":"2024-09-21T07:04:41.072772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:23.583516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074710+0000","last_change":"2024-09-21T07:04:40.069865+0000","last_active":"2024-09-21T07:04:41.074710+0000","last_peered":"2024-09-21T07:04:41.074710+0000","last_clean":"2024-09-21T07:04:41.074710+0000","last_became_active":"2024-09-21T07:04:40.069456+0000","last_became_peered":"2024-09-21T07:04:40.069456+0000","last_unstale":"2024-09-21T07:04:41.074710+0000","last_undegraded":"2024-09-21T07:04:41.074710+0000","last_fullsized":"2024-09-21T07:04:41.074710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072314+0000","last_change":"2024-09-21T07:04:40.065527+0000","last_active":"2024-09-21T07:04:41.072314+0000","last_peered":"2024-09-21T07:04:41.072314+0000","last_clean":"2024-09-21T07:04:41.072314+0000","last_became_active":"2024-09-21T07:04:40.065187+0000","last_became_peered":"2024-09-21T07:04:40.065187+0000","last_unstale":"2024-09-21T07:04:41.072314+0000","last_undegraded":"2024-09-21T07:04:41.072314+0000","last_fullsized":"2024-09-21T07:04:41.072314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.615948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057027+0000","last_change":"2024-09-21T07:04:40.074025+0000","last_active":"2024-09-21T07:04:41.057027+0000","last_peered":"2024-09-21T07:04:41.057027+0000","last_clean":"2024-09-21T07:04:41.057027+0000","last_became_active":"2024-09-21T07:04:40.073669+0000","last_became_peered":"2024-09-21T07:04:40.073669+0000","last_unstale":"2024-09-21T07:04:41.057027+0000","last_undegraded":"2024-09-21T07:04:41.057027+0000","last_fullsized":"2024-09-21T07:04:41.057027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:22.863209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074738+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:04:41.074738+0000","last_peered":"2024-09-21T07:04:41.074738+0000","last_clean":"2024-09-21T07:04:41.074738+0000","last_became_active":"2024-09-21T07:04:40.069645+0000","last_became_peered":"2024-09-21T07:04:40.069645+0000","last_unstale":"2024-09-21T07:04:41.074738+0000","last_undegraded":"2024-09-21T07:04:41.074738+0000","last_fullsized":"2024-09-21T07:04:41.074738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:03.108375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072569+0000","last_change":"2024-09-21T07:04:40.065818+0000","last_active":"2024-09-21T07:04:41.072569+0000","last_peered":"2024-09-21T07:04:41.072569+0000","last_clean":"2024-09-21T07:04:41.072569+0000","last_became_active":"2024-09-21T07:04:40.065422+0000","last_became_peered":"2024-09-21T07:04:40.065422+0000","last_unstale":"2024-09-21T07:04:41.072569+0000","last_undegraded":"2024-09-21T07:04:41.072569+0000","last_fullsized":"2024-09-21T07:04:41.072569+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:28.597574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073446+0000","last_change":"2024-09-21T07:04:40.064223+0000","last_active":"2024-09-21T07:04:41.073446+0000","last_peered":"2024-09-21T07:04:41.073446+0000","last_clean":"2024-09-21T07:04:41.073446+0000","last_became_active":"2024-09-21T07:04:40.057620+0000","last_became_peered":"2024-09-21T07:04:40.057620+0000","last_unstale":"2024-09-21T07:04:41.073446+0000","last_undegraded":"2024-09-21T07:04:41.073446+0000","last_fullsized":"2024-09-21T07:04:41.073446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:25.518187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072281+0000","last_change":"2024-09-21T07:04:40.070105+0000","last_active":"2024-09-21T07:04:41.072281+0000","last_peered":"2024-09-21T07:04:41.072281+0000","last_clean":"2024-09-21T07:04:41.072281+0000","last_became_active":"2024-09-21T07:04:40.068920+0000","last_became_peered":"2024-09-21T07:04:40.068920+0000","last_unstale":"2024-09-21T07:04:41.072281+0000","last_undegraded":"2024-09-21T07:04:41.072281+0000","last_fullsized":"2024-09-21T07:04:41.072281+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:51.847607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071580+0000","last_change":"2024-09-21T07:04:40.064852+0000","last_active":"2024-09-21T07:04:41.071580+0000","last_peered":"2024-09-21T07:04:41.071580+0000","last_clean":"2024-09-21T07:04:41.071580+0000","last_became_active":"2024-09-21T07:04:40.064476+0000","last_became_peered":"2024-09-21T07:04:40.064476+0000","last_unstale":"2024-09-21T07:04:41.071580+0000","last_undegraded":"2024-09-21T07:04:41.071580+0000","last_fullsized":"2024-09-21T07:04:41.071580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:45.579783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:02.378194+0000","last_change":"2024-09-21T07:04:38.052529+0000","last_active":"2024-09-21T07:05:02.378194+0000","last_peered":"2024-09-21T07:05:02.378194+0000","last_clean":"2024-09-21T07:05:02.378194+0000","last_became_active":"2024-09-21T07:04:38.052117+0000","last_became_peered":"2024-09-21T07:04:38.052117+0000","last_unstale":"2024-09-21T07:05:02.378194+0000","last_undegraded":"2024-09-21T07:05:02.378194+0000","last_fullsized":"2024-09-21T07:05:02.378194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:06.454006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058350+0000","last_change":"2024-09-21T07:04:40.077259+0000","last_active":"2024-09-21T07:04:41.058350+0000","last_peered":"2024-09-21T07:04:41.058350+0000","last_clean":"2024-09-21T07:04:41.058350+0000","last_became_active":"2024-09-21T07:04:40.076911+0000","last_became_peered":"2024-09-21T07:04:40.076911+0000","last_unstale":"2024-09-21T07:04:41.058350+0000","last_undegraded":"2024-09-21T07:04:41.058350+0000","last_fullsized":"2024-09-21T07:04:41.058350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:08.410875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.350139+0000","last_change":"2024-09-21T07:04:38.052545+0000","last_active":"2024-09-21T07:04:49.350139+0000","last_peered":"2024-09-21T07:04:49.350139+0000","last_clean":"2024-09-21T07:04:49.350139+0000","last_became_active":"2024-09-21T07:04:38.052115+0000","last_became_peered":"2024-09-21T07:04:38.052115+0000","last_unstale":"2024-09-21T07:04:49.350139+0000","last_undegraded":"2024-09-21T07:04:49.350139+0000","last_fullsized":"2024-09-21T07:04:49.350139+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.021727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351436+0000","last_change":"2024-09-21T07:04:38.050595+0000","last_active":"2024-09-21T07:04:49.351436+0000","last_peered":"2024-09-21T07:04:49.351436+0000","last_clean":"2024-09-21T07:04:49.351436+0000","last_became_active":"2024-09-21T07:04:38.050206+0000","last_became_peered":"2024-09-21T07:04:38.050206+0000","last_unstale":"2024-09-21T07:04:49.351436+0000","last_undegraded":"2024-09-21T07:04:49.351436+0000","last_fullsized":"2024-09-21T07:04:49.351436+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:37.746521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072110+0000","last_change":"2024-09-21T07:04:40.075300+0000","last_active":"2024-09-21T07:04:41.072110+0000","last_peered":"2024-09-21T07:04:41.072110+0000","last_clean":"2024-09-21T07:04:41.072110+0000","last_became_active":"2024-09-21T07:04:40.074959+0000","last_became_peered":"2024-09-21T07:04:40.074959+0000","last_unstale":"2024-09-21T07:04:41.072110+0000","last_undegraded":"2024-09-21T07:04:41.072110+0000","last_fullsized":"2024-09-21T07:04:41.072110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:42.935716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058670+0000","last_change":"2024-09-21T07:04:38.056440+0000","last_active":"2024-09-21T07:04:41.058670+0000","last_peered":"2024-09-21T07:04:41.058670+0000","last_clean":"2024-09-21T07:04:41.058670+0000","last_became_active":"2024-09-21T07:04:38.055917+0000","last_became_peered":"2024-09-21T07:04:38.055917+0000","last_unstale":"2024-09-21T07:04:41.058670+0000","last_undegraded":"2024-09-21T07:04:41.058670+0000","last_fullsized":"2024-09-21T07:04:41.058670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:54.090537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071760+0000","last_change":"2024-09-21T07:04:40.061602+0000","last_active":"2024-09-21T07:04:41.071760+0000","last_peered":"2024-09-21T07:04:41.071760+0000","last_clean":"2024-09-21T07:04:41.071760+0000","last_became_active":"2024-09-21T07:04:40.061209+0000","last_became_peered":"2024-09-21T07:04:40.061209+0000","last_unstale":"2024-09-21T07:04:41.071760+0000","last_undegraded":"2024-09-21T07:04:41.071760+0000","last_fullsized":"2024-09-21T07:04:41.071760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:31.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'3","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:02.377470+0000","last_change":"2024-09-21T07:04:38.053231+0000","last_active":"2024-09-21T07:05:02.377470+0000","last_peered":"2024-09-21T07:05:02.377470+0000","last_clean":"2024-09-21T07:05:02.377470+0000","last_became_active":"2024-09-21T07:04:38.052824+0000","last_became_peered":"2024-09-21T07:04:38.052824+0000","last_unstale":"2024-09-21T07:05:02.377470+0000","last_undegraded":"2024-09-21T07:05:02.377470+0000","last_fullsized":"2024-09-21T07:05:02.377470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:44.168096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077089+0000","last_change":"2024-09-21T07:04:40.070107+0000","last_active":"2024-09-21T07:04:41.077089+0000","last_peered":"2024-09-21T07:04:41.077089+0000","last_clean":"2024-09-21T07:04:41.077089+0000","last_became_active":"2024-09-21T07:04:40.069649+0000","last_became_peered":"2024-09-21T07:04:40.069649+0000","last_unstale":"2024-09-21T07:04:41.077089+0000","last_undegraded":"2024-09-21T07:04:41.077089+0000","last_fullsized":"2024-09-21T07:04:41.077089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.824442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.346083+0000","last_change":"2024-09-21T07:04:38.049413+0000","last_active":"2024-09-21T07:04:48.346083+0000","last_peered":"2024-09-21T07:04:48.346083+0000","last_clean":"2024-09-21T07:04:48.346083+0000","last_became_active":"2024-09-21T07:04:38.049034+0000","last_became_peered":"2024-09-21T07:04:38.049034+0000","last_unstale":"2024-09-21T07:04:48.346083+0000","last_undegraded":"2024-09-21T07:04:48.346083+0000","last_fullsized":"2024-09-21T07:04:48.346083+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.866543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075162+0000","last_change":"2024-09-21T07:04:40.075411+0000","last_active":"2024-09-21T07:04:41.075162+0000","last_peered":"2024-09-21T07:04:41.075162+0000","last_clean":"2024-09-21T07:04:41.075162+0000","last_became_active":"2024-09-21T07:04:40.074410+0000","last_became_peered":"2024-09-21T07:04:40.074410+0000","last_unstale":"2024-09-21T07:04:41.075162+0000","last_undegraded":"2024-09-21T07:04:41.075162+0000","last_fullsized":"2024-09-21T07:04:41.075162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:15.685477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343450+0000","last_change":"2024-09-21T07:04:38.138349+0000","last_active":"2024-09-21T07:04:48.343450+0000","last_peered":"2024-09-21T07:04:48.343450+0000","last_clean":"2024-09-21T07:04:48.343450+0000","last_became_active":"2024-09-21T07:04:38.137934+0000","last_became_peered":"2024-09-21T07:04:38.137934+0000","last_unstale":"2024-09-21T07:04:48.343450+0000","last_undegraded":"2024-09-21T07:04:48.343450+0000","last_fullsized":"2024-09-21T07:04:48.343450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.963760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077120+0000","last_change":"2024-09-21T07:04:40.076072+0000","last_active":"2024-09-21T07:04:41.077120+0000","last_peered":"2024-09-21T07:04:41.077120+0000","last_clean":"2024-09-21T07:04:41.077120+0000","last_became_active":"2024-09-21T07:04:40.075637+0000","last_became_peered":"2024-09-21T07:04:40.075637+0000","last_unstale":"2024-09-21T07:04:41.077120+0000","last_undegraded":"2024-09-21T07:04:41.077120+0000","last_fullsized":"2024-09-21T07:04:41.077120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:52.272797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'22","reported_seq":74,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:03.379636+0000","last_change":"2024-09-21T07:04:38.052777+0000","last_active":"2024-09-21T07:05:03.379636+0000","last_peered":"2024-09-21T07:05:03.379636+0000","last_clean":"2024-09-21T07:05:03.379636+0000","last_became_active":"2024-09-21T07:04:38.052319+0000","last_became_peered":"2024-09-21T07:04:38.052319+0000","last_unstale":"2024-09-21T07:05:03.379636+0000","last_undegraded":"2024-09-21T07:05:03.379636+0000","last_fullsized":"2024-09-21T07:05:03.379636+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:26.124318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":65,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074549+0000","last_change":"2024-09-21T07:04:40.073693+0000","last_active":"2024-09-21T07:04:41.074549+0000","last_peered":"2024-09-21T07:04:41.074549+0000","last_clean":"2024-09-21T07:04:41.074549+0000","last_became_active":"2024-09-21T07:04:40.073362+0000","last_became_peered":"2024-09-21T07:04:40.073362+0000","last_unstale":"2024-09-21T07:04:41.074549+0000","last_undegraded":"2024-09-21T07:04:41.074549+0000","last_fullsized":"2024-09-21T07:04:41.074549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:47.193733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'6","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.353012+0000","last_change":"2024-09-21T07:04:38.052881+0000","last_active":"2024-09-21T07:04:49.353012+0000","last_peered":"2024-09-21T07:04:49.353012+0000","last_clean":"2024-09-21T07:04:49.353012+0000","last_became_active":"2024-09-21T07:04:38.052499+0000","last_became_peered":"2024-09-21T07:04:38.052499+0000","last_unstale":"2024-09-21T07:04:49.353012+0000","last_undegraded":"2024-09-21T07:04:49.353012+0000","last_fullsized":"2024-09-21T07:04:49.353012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.871624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.056818+0000","last_change":"2024-09-21T07:04:40.070165+0000","last_active":"2024-09-21T07:04:41.056818+0000","last_peered":"2024-09-21T07:04:41.056818+0000","last_clean":"2024-09-21T07:04:41.056818+0000","last_became_active":"2024-09-21T07:04:40.068422+0000","last_became_peered":"2024-09-21T07:04:40.068422+0000","last_unstale":"2024-09-21T07:04:41.056818+0000","last_undegraded":"2024-09-21T07:04:41.056818+0000","last_fullsized":"2024-09-21T07:04:41.056818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:09.593392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345508+0000","last_change":"2024-09-21T07:04:38.053713+0000","last_active":"2024-09-21T07:04:48.345508+0000","last_peered":"2024-09-21T07:04:48.345508+0000","last_clean":"2024-09-21T07:04:48.345508+0000","last_became_active":"2024-09-21T07:04:38.053283+0000","last_became_peered":"2024-09-21T07:04:38.053283+0000","last_unstale":"2024-09-21T07:04:48.345508+0000","last_undegraded":"2024-09-21T07:04:48.345508+0000","last_fullsized":"2024-09-21T07:04:48.345508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:53.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074279+0000","last_change":"2024-09-21T07:04:40.080396+0000","last_active":"2024-09-21T07:04:41.074279+0000","last_peered":"2024-09-21T07:04:41.074279+0000","last_clean":"2024-09-21T07:04:41.074279+0000","last_became_active":"2024-09-21T07:04:40.080040+0000","last_became_peered":"2024-09-21T07:04:40.080040+0000","last_unstale":"2024-09-21T07:04:41.074279+0000","last_undegraded":"2024-09-21T07:04:41.074279+0000","last_fullsized":"2024-09-21T07:04:41.074279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:26.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'3","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:02.379700+0000","last_change":"2024-09-21T07:04:38.051776+0000","last_active":"2024-09-21T07:05:02.379700+0000","last_peered":"2024-09-21T07:05:02.379700+0000","last_clean":"2024-09-21T07:05:02.379700+0000","last_became_active":"2024-09-21T07:04:38.048551+0000","last_became_peered":"2024-09-21T07:04:38.048551+0000","last_unstale":"2024-09-21T07:05:02.379700+0000","last_undegraded":"2024-09-21T07:05:02.379700+0000","last_fullsized":"2024-09-21T07:05:02.379700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.640949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073395+0000","last_change":"2024-09-21T07:04:40.066595+0000","last_active":"2024-09-21T07:04:41.073395+0000","last_peered":"2024-09-21T07:04:41.073395+0000","last_clean":"2024-09-21T07:04:41.073395+0000","last_became_active":"2024-09-21T07:04:40.063872+0000","last_became_peered":"2024-09-21T07:04:40.063872+0000","last_unstale":"2024-09-21T07:04:41.073395+0000","last_undegraded":"2024-09-21T07:04:41.073395+0000","last_fullsized":"2024-09-21T07:04:41.073395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:37.820834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'15","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352950+0000","last_change":"2024-09-21T07:04:38.138472+0000","last_active":"2024-09-21T07:04:49.352950+0000","last_peered":"2024-09-21T07:04:49.352950+0000","last_clean":"2024-09-21T07:04:49.352950+0000","last_became_active":"2024-09-21T07:04:38.138095+0000","last_became_peered":"2024-09-21T07:04:38.138095+0000","last_unstale":"2024-09-21T07:04:49.352950+0000","last_undegraded":"2024-09-21T07:04:49.352950+0000","last_fullsized":"2024-09-21T07:04:49.352950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:50.789021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058640+0000","last_change":"2024-09-21T07:04:40.076508+0000","last_active":"2024-09-21T07:04:41.058640+0000","last_peered":"2024-09-21T07:04:41.058640+0000","last_clean":"2024-09-21T07:04:41.058640+0000","last_became_active":"2024-09-21T07:04:40.076115+0000","last_became_peered":"2024-09-21T07:04:40.076115+0000","last_unstale":"2024-09-21T07:04:41.058640+0000","last_undegraded":"2024-09-21T07:04:41.058640+0000","last_fullsized":"2024-09-21T07:04:41.058640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:19.803762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:50.355370+0000","last_change":"2024-09-21T07:04:38.056502+0000","last_active":"2024-09-21T07:04:50.355370+0000","last_peered":"2024-09-21T07:04:50.355370+0000","last_clean":"2024-09-21T07:04:50.355370+0000","last_became_active":"2024-09-21T07:04:38.056146+0000","last_became_peered":"2024-09-21T07:04:38.056146+0000","last_unstale":"2024-09-21T07:04:50.355370+0000","last_undegraded":"2024-09-21T07:04:50.355370+0000","last_fullsized":"2024-09-21T07:04:50.355370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072078+0000","last_change":"2024-09-21T07:04:40.076494+0000","last_active":"2024-09-21T07:04:41.072078+0000","last_peered":"2024-09-21T07:04:41.072078+0000","last_clean":"2024-09-21T07:04:41.072078+0000","last_became_active":"2024-09-21T07:04:40.076156+0000","last_became_peered":"2024-09-21T07:04:40.076156+0000","last_unstale":"2024-09-21T07:04:41.072078+0000","last_undegraded":"2024-09-21T07:04:41.072078+0000","last_fullsized":"2024-09-21T07:04:41.072078+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:07.264957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.076756+0000","last_change":"2024-09-21T07:04:38.051857+0000","last_active":"2024-09-21T07:04:41.076756+0000","last_peered":"2024-09-21T07:04:41.076756+0000","last_clean":"2024-09-21T07:04:41.076756+0000","last_became_active":"2024-09-21T07:04:38.051364+0000","last_became_peered":"2024-09-21T07:04:38.051364+0000","last_unstale":"2024-09-21T07:04:41.076756+0000","last_undegraded":"2024-09-21T07:04:41.076756+0000","last_fullsized":"2024-09-21T07:04:41.076756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:48.718078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074474+0000","last_change":"2024-09-21T07:04:40.075163+0000","last_active":"2024-09-21T07:04:41.074474+0000","last_peered":"2024-09-21T07:04:41.074474+0000","last_clean":"2024-09-21T07:04:41.074474+0000","last_became_active":"2024-09-21T07:04:40.074784+0000","last_became_peered":"2024-09-21T07:04:40.074784+0000","last_unstale":"2024-09-21T07:04:41.074474+0000","last_undegraded":"2024-09-21T07:04:41.074474+0000","last_fullsized":"2024-09-21T07:04:41.074474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:40.334326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.079239+0000","last_change":"2024-09-21T07:04:38.051940+0000","last_active":"2024-09-21T07:04:41.079239+0000","last_peered":"2024-09-21T07:04:41.079239+0000","last_clean":"2024-09-21T07:04:41.079239+0000","last_became_active":"2024-09-21T07:04:38.051300+0000","last_became_peered":"2024-09-21T07:04:38.051300+0000","last_unstale":"2024-09-21T07:04:41.079239+0000","last_undegraded":"2024-09-21T07:04:41.079239+0000","last_fullsized":"2024-09-21T07:04:41.079239+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:36.703119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.920730+0000","last_change":"2024-09-21T07:04:40.067171+0000","last_active":"2024-09-21T07:04:41.920730+0000","last_peered":"2024-09-21T07:04:41.920730+0000","last_clean":"2024-09-21T07:04:41.920730+0000","last_became_active":"2024-09-21T07:04:40.066801+0000","last_became_peered":"2024-09-21T07:04:40.066801+0000","last_unstale":"2024-09-21T07:04:41.920730+0000","last_undegraded":"2024-09-21T07:04:41.920730+0000","last_fullsized":"2024-09-21T07:04:41.920730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:30.885860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352620+0000","last_change":"2024-09-21T07:04:38.138427+0000","last_active":"2024-09-21T07:04:49.352620+0000","last_peered":"2024-09-21T07:04:49.352620+0000","last_clean":"2024-09-21T07:04:49.352620+0000","last_became_active":"2024-09-21T07:04:38.137983+0000","last_became_peered":"2024-09-21T07:04:38.137983+0000","last_unstale":"2024-09-21T07:04:49.352620+0000","last_undegraded":"2024-09-21T07:04:49.352620+0000","last_fullsized":"2024-09-21T07:04:49.352620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:43.544784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074729+0000","last_change":"2024-09-21T07:04:40.074114+0000","last_active":"2024-09-21T07:04:41.074729+0000","last_peered":"2024-09-21T07:04:41.074729+0000","last_clean":"2024-09-21T07:04:41.074729+0000","last_became_active":"2024-09-21T07:04:40.073736+0000","last_became_peered":"2024-09-21T07:04:40.073736+0000","last_unstale":"2024-09-21T07:04:41.074729+0000","last_undegraded":"2024-09-21T07:04:41.074729+0000","last_fullsized":"2024-09-21T07:04:41.074729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:42.735634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":93,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073747+0000","last_change":"2024-09-21T07:03:25.075453+0000","last_active":"2024-09-21T07:04:41.073747+0000","last_peered":"2024-09-21T07:04:41.073747+0000","last_clean":"2024-09-21T07:04:41.073747+0000","last_became_active":"2024-09-21T07:03:25.069192+0000","last_became_peered":"2024-09-21T07:03:25.069192+0000","last_unstale":"2024-09-21T07:04:41.073747+0000","last_undegraded":"2024-09-21T07:04:41.073747+0000","last_fullsized":"2024-09-21T07:04:41.073747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_clean_scrub_stamp":"2024-09-21T06:59:59.393354+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:56.048484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'3","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:50.356131+0000","last_change":"2024-09-21T07:04:38.051627+0000","last_active":"2024-09-21T07:04:50.356131+0000","last_peered":"2024-09-21T07:04:50.356131+0000","last_clean":"2024-09-21T07:04:50.356131+0000","last_became_active":"2024-09-21T07:04:38.050547+0000","last_became_peered":"2024-09-21T07:04:38.050547+0000","last_unstale":"2024-09-21T07:04:50.356131+0000","last_undegraded":"2024-09-21T07:04:50.356131+0000","last_fullsized":"2024-09-21T07:04:50.356131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:11.607629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073518+0000","last_change":"2024-09-21T07:04:40.065627+0000","last_active":"2024-09-21T07:04:41.073518+0000","last_peered":"2024-09-21T07:04:41.073518+0000","last_clean":"2024-09-21T07:04:41.073518+0000","last_became_active":"2024-09-21T07:04:40.065265+0000","last_became_peered":"2024-09-21T07:04:40.065265+0000","last_unstale":"2024-09-21T07:04:41.073518+0000","last_undegraded":"2024-09-21T07:04:41.073518+0000","last_fullsized":"2024-09-21T07:04:41.073518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:01.950229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351430+0000","last_change":"2024-09-21T07:04:38.052441+0000","last_active":"2024-09-21T07:04:49.351430+0000","last_peered":"2024-09-21T07:04:49.351430+0000","last_clean":"2024-09-21T07:04:49.351430+0000","last_became_active":"2024-09-21T07:04:38.052075+0000","last_became_peered":"2024-09-21T07:04:38.052075+0000","last_unstale":"2024-09-21T07:04:49.351430+0000","last_undegraded":"2024-09-21T07:04:49.351430+0000","last_fullsized":"2024-09-21T07:04:49.351430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.649120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.056828+0000","last_change":"2024-09-21T07:04:40.066421+0000","last_active":"2024-09-21T07:04:41.056828+0000","last_peered":"2024-09-21T07:04:41.056828+0000","last_clean":"2024-09-21T07:04:41.056828+0000","last_became_active":"2024-09-21T07:04:40.066049+0000","last_became_peered":"2024-09-21T07:04:40.066049+0000","last_unstale":"2024-09-21T07:04:41.056828+0000","last_undegraded":"2024-09-21T07:04:41.056828+0000","last_fullsized":"2024-09-21T07:04:41.056828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:03.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'4","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:04.381824+0000","last_change":"2024-09-21T07:04:38.137231+0000","last_active":"2024-09-21T07:05:04.381824+0000","last_peered":"2024-09-21T07:05:04.381824+0000","last_clean":"2024-09-21T07:05:04.381824+0000","last_became_active":"2024-09-21T07:04:38.136854+0000","last_became_peered":"2024-09-21T07:04:38.136854+0000","last_unstale":"2024-09-21T07:05:04.381824+0000","last_undegraded":"2024-09-21T07:05:04.381824+0000","last_fullsized":"2024-09-21T07:05:04.381824+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:58.386863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058056+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:04:41.058056+0000","last_peered":"2024-09-21T07:04:41.058056+0000","last_clean":"2024-09-21T07:04:41.058056+0000","last_became_active":"2024-09-21T07:04:40.076144+0000","last_became_peered":"2024-09-21T07:04:40.076144+0000","last_unstale":"2024-09-21T07:04:41.058056+0000","last_undegraded":"2024-09-21T07:04:41.058056+0000","last_fullsized":"2024-09-21T07:04:41.058056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:51.520464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.920705+0000","last_change":"2024-09-21T07:04:38.048223+0000","last_active":"2024-09-21T07:04:41.920705+0000","last_peered":"2024-09-21T07:04:41.920705+0000","last_clean":"2024-09-21T07:04:41.920705+0000","last_became_active":"2024-09-21T07:04:38.047761+0000","last_became_peered":"2024-09-21T07:04:38.047761+0000","last_unstale":"2024-09-21T07:04:41.920705+0000","last_undegraded":"2024-09-21T07:04:41.920705+0000","last_fullsized":"2024-09-21T07:04:41.920705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:50.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071211+0000","last_change":"2024-09-21T07:04:40.076961+0000","last_active":"2024-09-21T07:04:41.071211+0000","last_peered":"2024-09-21T07:04:41.071211+0000","last_clean":"2024-09-21T07:04:41.071211+0000","last_became_active":"2024-09-21T07:04:40.076572+0000","last_became_peered":"2024-09-21T07:04:40.076572+0000","last_unstale":"2024-09-21T07:04:41.071211+0000","last_undegraded":"2024-09-21T07:04:41.071211+0000","last_fullsized":"2024-09-21T07:04:41.071211+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.688173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.071625+0000","last_change":"2024-09-21T07:04:38.138897+0000","last_active":"2024-09-21T07:04:41.071625+0000","last_peered":"2024-09-21T07:04:41.071625+0000","last_clean":"2024-09-21T07:04:41.071625+0000","last_became_active":"2024-09-21T07:04:38.138510+0000","last_became_peered":"2024-09-21T07:04:38.138510+0000","last_unstale":"2024-09-21T07:04:41.071625+0000","last_undegraded":"2024-09-21T07:04:41.071625+0000","last_fullsized":"2024-09-21T07:04:41.071625+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:27.244819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:44.012020+0000","last_change":"2024-09-21T07:04:40.064091+0000","last_active":"2024-09-21T07:04:44.012020+0000","last_peered":"2024-09-21T07:04:44.012020+0000","last_clean":"2024-09-21T07:04:44.012020+0000","last_became_active":"2024-09-21T07:04:40.063704+0000","last_became_peered":"2024-09-21T07:04:40.063704+0000","last_unstale":"2024-09-21T07:04:44.012020+0000","last_undegraded":"2024-09-21T07:04:44.012020+0000","last_fullsized":"2024-09-21T07:04:44.012020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:35.838486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343943+0000","last_change":"2024-09-21T07:04:38.138326+0000","last_active":"2024-09-21T07:04:48.343943+0000","last_peered":"2024-09-21T07:04:48.343943+0000","last_clean":"2024-09-21T07:04:48.343943+0000","last_became_active":"2024-09-21T07:04:38.137933+0000","last_became_peered":"2024-09-21T07:04:38.137933+0000","last_unstale":"2024-09-21T07:04:48.343943+0000","last_undegraded":"2024-09-21T07:04:48.343943+0000","last_fullsized":"2024-09-21T07:04:48.343943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:32.569458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.057183+0000","last_change":"2024-09-21T07:04:40.058661+0000","last_active":"2024-09-21T07:04:41.057183+0000","last_peered":"2024-09-21T07:04:41.057183+0000","last_clean":"2024-09-21T07:04:41.057183+0000","last_became_active":"2024-09-21T07:04:40.058198+0000","last_became_peered":"2024-09-21T07:04:40.058198+0000","last_unstale":"2024-09-21T07:04:41.057183+0000","last_undegraded":"2024-09-21T07:04:41.057183+0000","last_fullsized":"2024-09-21T07:04:41.057183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:17.876087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:05:00.070366+0000","last_change":"2024-09-21T07:04:38.048742+0000","last_active":"2024-09-21T07:05:00.070366+0000","last_peered":"2024-09-21T07:05:00.070366+0000","last_clean":"2024-09-21T07:05:00.070366+0000","last_became_active":"2024-09-21T07:04:38.048360+0000","last_became_peered":"2024-09-21T07:04:38.048360+0000","last_unstale":"2024-09-21T07:05:00.070366+0000","last_undegraded":"2024-09-21T07:05:00.070366+0000","last_fullsized":"2024-09-21T07:05:00.070366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:00.977592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075596+0000","last_change":"2024-09-21T07:04:40.076235+0000","last_active":"2024-09-21T07:04:41.075596+0000","last_peered":"2024-09-21T07:04:41.075596+0000","last_clean":"2024-09-21T07:04:41.075596+0000","last_became_active":"2024-09-21T07:04:40.075888+0000","last_became_peered":"2024-09-21T07:04:40.075888+0000","last_unstale":"2024-09-21T07:04:41.075596+0000","last_undegraded":"2024-09-21T07:04:41.075596+0000","last_fullsized":"2024-09-21T07:04:41.075596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:21.277910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343674+0000","last_change":"2024-09-21T07:04:38.054023+0000","last_active":"2024-09-21T07:04:48.343674+0000","last_peered":"2024-09-21T07:04:48.343674+0000","last_clean":"2024-09-21T07:04:48.343674+0000","last_became_active":"2024-09-21T07:04:38.053621+0000","last_became_peered":"2024-09-21T07:04:38.053621+0000","last_unstale":"2024-09-21T07:04:48.343674+0000","last_undegraded":"2024-09-21T07:04:48.343674+0000","last_fullsized":"2024-09-21T07:04:48.343674+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:10.732857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074757+0000","last_change":"2024-09-21T07:04:40.068522+0000","last_active":"2024-09-21T07:04:41.074757+0000","last_peered":"2024-09-21T07:04:41.074757+0000","last_clean":"2024-09-21T07:04:41.074757+0000","last_became_active":"2024-09-21T07:04:40.068119+0000","last_became_peered":"2024-09-21T07:04:40.068119+0000","last_unstale":"2024-09-21T07:04:41.074757+0000","last_undegraded":"2024-09-21T07:04:41.074757+0000","last_fullsized":"2024-09-21T07:04:41.074757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:43.963965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345656+0000","last_change":"2024-09-21T07:04:38.138336+0000","last_active":"2024-09-21T07:04:48.345656+0000","last_peered":"2024-09-21T07:04:48.345656+0000","last_clean":"2024-09-21T07:04:48.345656+0000","last_became_active":"2024-09-21T07:04:38.138002+0000","last_became_peered":"2024-09-21T07:04:38.138002+0000","last_unstale":"2024-09-21T07:04:48.345656+0000","last_undegraded":"2024-09-21T07:04:48.345656+0000","last_fullsized":"2024-09-21T07:04:48.345656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.594369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.073805+0000","last_change":"2024-09-21T07:04:40.073385+0000","last_active":"2024-09-21T07:04:41.073805+0000","last_peered":"2024-09-21T07:04:41.073805+0000","last_clean":"2024-09-21T07:04:41.073805+0000","last_became_active":"2024-09-21T07:04:40.072962+0000","last_became_peered":"2024-09-21T07:04:40.072962+0000","last_unstale":"2024-09-21T07:04:41.073805+0000","last_undegraded":"2024-09-21T07:04:41.073805+0000","last_fullsized":"2024-09-21T07:04:41.073805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:14.656729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.343212+0000","last_change":"2024-09-21T07:04:38.048141+0000","last_active":"2024-09-21T07:04:48.343212+0000","last_peered":"2024-09-21T07:04:48.343212+0000","last_clean":"2024-09-21T07:04:48.343212+0000","last_became_active":"2024-09-21T07:04:38.047717+0000","last_became_peered":"2024-09-21T07:04:38.047717+0000","last_unstale":"2024-09-21T07:04:48.343212+0000","last_undegraded":"2024-09-21T07:04:48.343212+0000","last_fullsized":"2024-09-21T07:04:48.343212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:55.920716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072528+0000","last_change":"2024-09-21T07:04:40.069741+0000","last_active":"2024-09-21T07:04:41.072528+0000","last_peered":"2024-09-21T07:04:41.072528+0000","last_clean":"2024-09-21T07:04:41.072528+0000","last_became_active":"2024-09-21T07:04:40.069256+0000","last_became_peered":"2024-09-21T07:04:40.069256+0000","last_unstale":"2024-09-21T07:04:41.072528+0000","last_undegraded":"2024-09-21T07:04:41.072528+0000","last_fullsized":"2024-09-21T07:04:41.072528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:50.484011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075145+0000","last_change":"2024-09-21T07:04:38.050014+0000","last_active":"2024-09-21T07:04:41.075145+0000","last_peered":"2024-09-21T07:04:41.075145+0000","last_clean":"2024-09-21T07:04:41.075145+0000","last_became_active":"2024-09-21T07:04:38.049277+0000","last_became_peered":"2024-09-21T07:04:38.049277+0000","last_unstale":"2024-09-21T07:04:41.075145+0000","last_undegraded":"2024-09-21T07:04:41.075145+0000","last_fullsized":"2024-09-21T07:04:41.075145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:43.365126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.072512+0000","last_change":"2024-09-21T07:04:40.065254+0000","last_active":"2024-09-21T07:04:41.072512+0000","last_peered":"2024-09-21T07:04:41.072512+0000","last_clean":"2024-09-21T07:04:41.072512+0000","last_became_active":"2024-09-21T07:04:40.064660+0000","last_became_peered":"2024-09-21T07:04:40.064660+0000","last_unstale":"2024-09-21T07:04:41.072512+0000","last_undegraded":"2024-09-21T07:04:41.072512+0000","last_fullsized":"2024-09-21T07:04:41.072512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:05.731169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:48.345683+0000","last_change":"2024-09-21T07:04:38.055323+0000","last_active":"2024-09-21T07:04:48.345683+0000","last_peered":"2024-09-21T07:04:48.345683+0000","last_clean":"2024-09-21T07:04:48.345683+0000","last_became_active":"2024-09-21T07:04:38.054953+0000","last_became_peered":"2024-09-21T07:04:38.054953+0000","last_unstale":"2024-09-21T07:04:48.345683+0000","last_undegraded":"2024-09-21T07:04:48.345683+0000","last_fullsized":"2024-09-21T07:04:48.345683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:47.009187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074054+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:04:41.074054+0000","last_peered":"2024-09-21T07:04:41.074054+0000","last_clean":"2024-09-21T07:04:41.074054+0000","last_became_active":"2024-09-21T07:04:40.069662+0000","last_became_peered":"2024-09-21T07:04:40.069662+0000","last_unstale":"2024-09-21T07:04:41.074054+0000","last_undegraded":"2024-09-21T07:04:41.074054+0000","last_fullsized":"2024-09-21T07:04:41.074054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:44.556304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.058303+0000","last_change":"2024-09-21T07:04:40.079299+0000","last_active":"2024-09-21T07:04:41.058303+0000","last_peered":"2024-09-21T07:04:41.058303+0000","last_clean":"2024-09-21T07:04:41.058303+0000","last_became_active":"2024-09-21T07:04:40.078909+0000","last_became_peered":"2024-09-21T07:04:40.078909+0000","last_unstale":"2024-09-21T07:04:41.058303+0000","last_undegraded":"2024-09-21T07:04:41.058303+0000","last_fullsized":"2024-09-21T07:04:41.058303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:37.600505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.080762+0000","last_change":"2024-09-21T07:04:38.055743+0000","last_active":"2024-09-21T07:04:41.080762+0000","last_peered":"2024-09-21T07:04:41.080762+0000","last_clean":"2024-09-21T07:04:41.080762+0000","last_became_active":"2024-09-21T07:04:38.055344+0000","last_became_peered":"2024-09-21T07:04:38.055344+0000","last_unstale":"2024-09-21T07:04:41.080762+0000","last_undegraded":"2024-09-21T07:04:41.080762+0000","last_fullsized":"2024-09-21T07:04:41.080762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:32.610947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.077113+0000","last_change":"2024-09-21T07:04:40.069789+0000","last_active":"2024-09-21T07:04:41.077113+0000","last_peered":"2024-09-21T07:04:41.077113+0000","last_clean":"2024-09-21T07:04:41.077113+0000","last_became_active":"2024-09-21T07:04:40.069399+0000","last_became_peered":"2024-09-21T07:04:40.069399+0000","last_unstale":"2024-09-21T07:04:41.077113+0000","last_undegraded":"2024-09-21T07:04:41.077113+0000","last_fullsized":"2024-09-21T07:04:41.077113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:15.300569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.351198+0000","last_change":"2024-09-21T07:04:38.049466+0000","last_active":"2024-09-21T07:04:49.351198+0000","last_peered":"2024-09-21T07:04:49.351198+0000","last_clean":"2024-09-21T07:04:49.351198+0000","last_became_active":"2024-09-21T07:04:38.049067+0000","last_became_peered":"2024-09-21T07:04:38.049067+0000","last_unstale":"2024-09-21T07:04:49.351198+0000","last_undegraded":"2024-09-21T07:04:49.351198+0000","last_fullsized":"2024-09-21T07:04:49.351198+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.514610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.075109+0000","last_change":"2024-09-21T07:04:40.072590+0000","last_active":"2024-09-21T07:04:41.075109+0000","last_peered":"2024-09-21T07:04:41.075109+0000","last_clean":"2024-09-21T07:04:41.075109+0000","last_became_active":"2024-09-21T07:04:40.071776+0000","last_became_peered":"2024-09-21T07:04:40.071776+0000","last_unstale":"2024-09-21T07:04:41.075109+0000","last_undegraded":"2024-09-21T07:04:41.075109+0000","last_fullsized":"2024-09-21T07:04:41.075109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:41.742797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.079632+0000","last_change":"2024-09-21T07:04:38.137558+0000","last_active":"2024-09-21T07:04:41.079632+0000","last_peered":"2024-09-21T07:04:41.079632+0000","last_clean":"2024-09-21T07:04:41.079632+0000","last_became_active":"2024-09-21T07:04:38.137173+0000","last_became_peered":"2024-09-21T07:04:38.137173+0000","last_unstale":"2024-09-21T07:04:41.079632+0000","last_undegraded":"2024-09-21T07:04:41.079632+0000","last_fullsized":"2024-09-21T07:04:41.079632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:18.624886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:41.074099+0000","last_change":"2024-09-21T07:04:40.069596+0000","last_active":"2024-09-21T07:04:41.074099+0000","last_peered":"2024-09-21T07:04:41.074099+0000","last_clean":"2024-09-21T07:04:41.074099+0000","last_became_active":"2024-09-21T07:04:40.069095+0000","last_became_peered":"2024-09-21T07:04:40.069095+0000","last_unstale":"2024-09-21T07:04:41.074099+0000","last_undegraded":"2024-09-21T07:04:41.074099+0000","last_fullsized":"2024-09-21T07:04:41.074099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.139930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'9","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-21T07:04:49.352968+0000","last_change":"2024-09-21T07:04:38.052552+0000","last_active":"2024-09-21T07:04:49.352968+0000","last_peered":"2024-09-21T07:04:49.352968+0000","last_clean":"2024-09-21T07:04:49.352968+0000","last_became_active":"2024-09-21T07:04:38.052074+0000","last_became_peered":"2024-09-21T07:04:38.052074+0000","last_unstale":"2024-09-21T07:04:49.352968+0000","last_undegraded":"2024-09-21T07:04:49.352968+0000","last_fullsized":"2024-09-21T07:04:49.352968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:59.280299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54550,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":113,"num_write":147,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":163650,"data_compressed":5673,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":249413,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841554,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":778240,"data_stored":376596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037783,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1019017,"data_compressed":38214,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":376832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":376752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561062,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":968291,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724587,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":376221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":967975,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":376658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":798720,"data_stored":376532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":428304,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":426954,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":50940,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":52290,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52518,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:05:08.781 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:05:08.782 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:05:08.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:05:08.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:08 smithi129 ceph-mon[34863]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:09.047 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:09.456 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:09 smithi028 ceph-mon[31213]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 -- 172.21.15.28:0/2108220307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c06b980 msgr2=0x7fe07c106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 --2- 172.21.15.28:0/2108220307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c06b980 0x7fe07c106390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009900 tx=0x7fe06c02a410 comp rx=0 tx=0).stop 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 -- 172.21.15.28:0/2108220307 shutdown_connections 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 --2- 172.21.15.28:0/2108220307 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c109470 0x7fe07c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 --2- 172.21.15.28:0/2108220307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 --2- 172.21.15.28:0/2108220307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c06b980 0x7fe07c106390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 -- 172.21.15.28:0/2108220307 >> 172.21.15.28:0/2108220307 conn(0x7fe07c0fdfb0 msgr2=0x7fe07c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 -- 172.21.15.28:0/2108220307 shutdown_connections 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.555+0000 7fe080e76640 1 -- 172.21.15.28:0/2108220307 wait complete. 2024-09-21T07:05:09.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 Processor -- start 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 -- start start 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c06b980 0x7fe07c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10f380 con 0x7fe07c109470 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10f200 con 0x7fe07c06b980 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe080e76640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10f500 con 0x7fe07c1068d0 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe07ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe073fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe07ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53016/0 (socket says 172.21.15.28:53016) 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe07ad9d640 1 -- 172.21.15.28:0/1707711065 learned_addr learned my addr 172.21.15.28:0/1707711065 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.556+0000 7fe07a59c640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c06b980 0x7fe07c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:09.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 -- 172.21.15.28:0/1707711065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 msgr2=0x7fe07c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 -- 172.21.15.28:0/1707711065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c06b980 msgr2=0x7fe07c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c06b980 0x7fe07c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 -- 172.21.15.28:0/1707711065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c19b9e0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe073fff640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe07ad9d640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe07400eaa0 tx=0x7fe07400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07400cdb0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe074005020 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740116d0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c19bcd0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.557+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1a23d0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.558+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c0ffad0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.559+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe0740051d0 con 0x7fe07c109470 2024-09-21T07:05:09.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.560+0000 7fe0737fe640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 0x7fe0680b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:09.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.560+0000 7fe07a59c640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 0x7fe0680b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:09.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.560+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fe0740e7850 con 0x7fe07c109470 2024-09-21T07:05:09.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.561+0000 7fe07a59c640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 0x7fe0680b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe06c000c00 tx=0x7fe06c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:09.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.564+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe074016030 con 0x7fe07c109470 2024-09-21T07:05:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:09 smithi181 ceph-mon[34686]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-21T07:05:09.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.827+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe07c02e640 con 0x7fe07c109470 2024-09-21T07:05:09.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.830+0000 7fe0737fe640 1 -- 172.21.15.28:0/1707711065 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fe0740b2510 con 0x7fe07c109470 2024-09-21T07:05:09.832 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-21T07:05:09.832 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAlcO5mYQhtMRAADVaSx7tuoljXVfLcNSWE0g== 2024-09-21T07:05:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 msgr2=0x7fe0680b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 0x7fe0680b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe06c000c00 tx=0x7fe06c031400 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 msgr2=0x7fe07c19b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe07400eaa0 tx=0x7fe07400ef60 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 shutdown_connections 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fe0680b65a0 0x7fe0680b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe07c109470 0x7fe07c19b1c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe07c1068d0 0x7fe07c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 --2- 172.21.15.28:0/1707711065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe07c06b980 0x7fe07c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 >> 172.21.15.28:0/1707711065 conn(0x7fe07c0fdfb0 msgr2=0x7fe07c104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 shutdown_connections 2024-09-21T07:05:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:09.832+0000 7fe080e76640 1 -- 172.21.15.28:0/1707711065 wait complete. 2024-09-21T07:05:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:09 smithi129 ceph-mon[34863]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-21T07:05:10.579 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T07:05:10.579 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:05:10.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:05:10.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:05:10.683 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:10 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:05:10.683 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:10 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:05:10.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:10 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:05:10.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:10 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:05:10.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:10 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:05:10.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:10 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1707711065' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:05:10.920 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:11.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 -- 172.21.15.28:0/970799615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3144102a60 msgr2=0x7f3144102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:11.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 --2- 172.21.15.28:0/970799615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3144102a60 0x7f3144102e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3134009900 tx=0x7f313402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:11.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 -- 172.21.15.28:0/970799615 shutdown_connections 2024-09-21T07:05:11.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 --2- 172.21.15.28:0/970799615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 0x7f314410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 --2- 172.21.15.28:0/970799615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f31441083a0 0x7f31441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 --2- 172.21.15.28:0/970799615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3144102a60 0x7f3144102e70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 -- 172.21.15.28:0/970799615 >> 172.21.15.28:0/970799615 conn(0x7f3144079730 msgr2=0x7f3144079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 -- 172.21.15.28:0/970799615 shutdown_connections 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.398+0000 7f3149a9e640 1 -- 172.21.15.28:0/970799615 wait complete. 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 Processor -- start 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 -- start start 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3144102a60 0x7f3144199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 0x7f314419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3144112960 con 0x7f31441083a0 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f31441127e0 con 0x7f3144102a60 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3149a9e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3144112ae0 con 0x7f3144108cf0 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f313bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:11.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f313bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53036/0 (socket says 172.21.15.28:53036) 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f313bfff640 1 -- 172.21.15.28:0/2511358306 learned_addr learned my addr 172.21.15.28:0/2511358306 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f31437fe640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3144102a60 0x7f3144199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.399+0000 7f3143fff640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 0x7f314419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 -- 172.21.15.28:0/2511358306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 msgr2=0x7f314419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 0x7f314419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 -- 172.21.15.28:0/2511358306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3144102a60 msgr2=0x7f3144199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3144102a60 0x7f3144199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 -- 172.21.15.28:0/2511358306 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314419f2e0 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f313bfff640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d770 tx=0x7f312c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c017070 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f312c009c30 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314419f5d0 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c00f620 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.400+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a5d30 con 0x7f31441083a0 2024-09-21T07:05:11.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.401+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3144102e70 con 0x7f31441083a0 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.403+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f312c01a070 con 0x7f31441083a0 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.404+0000 7f31417fa640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 0x7f31300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.404+0000 7f31437fe640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 0x7f31300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.404+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f312c0e6d50 con 0x7f31441083a0 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.404+0000 7f31437fe640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 0x7f31300b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3134031440 tx=0x7f3134009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.407+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f312c009de0 con 0x7f31441083a0 2024-09-21T07:05:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.598+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f314419a4a0 con 0x7f31441083a0 2024-09-21T07:05:11.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.599+0000 7f31417fa640 1 -- 172.21.15.28:0/2511358306 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f314419a4a0 con 0x7f31441083a0 2024-09-21T07:05:11.601 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 msgr2=0x7f31300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 0x7f31300b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3134031440 tx=0x7f3134009560 comp rx=0 tx=0).stop 2024-09-21T07:05:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 msgr2=0x7f3144199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d770 tx=0x7f312c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:05:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 shutdown_connections 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f31300b6620 0x7f31300b8b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3144108cf0 0x7f314419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31441083a0 0x7f3144199910 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 --2- 172.21.15.28:0/2511358306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3144102a60 0x7f3144199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 >> 172.21.15.28:0/2511358306 conn(0x7f3144079730 msgr2=0x7f31441014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 shutdown_connections 2024-09-21T07:05:11.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:11.601+0000 7f3149a9e640 1 -- 172.21.15.28:0/2511358306 wait complete. 2024-09-21T07:05:11.919 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:11 smithi028 ceph-mon[31213]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T07:05:11.920 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:11 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2511358306' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:05:12.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:11 smithi129 ceph-mon[34863]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T07:05:12.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:11 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2511358306' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:05:12.240 INFO:teuthology.orchestra.run.smithi028.stdout:[{"version":53,"timestamp":"2024-09-21T07:04:30.005767+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:05:12.240 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T07:05:12.241 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:05:12.241 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:05:12.241 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:05:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:11 smithi181 ceph-mon[34686]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T07:05:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:11 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2511358306' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:05:12.540 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:12.915 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T07:05:12.915 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:05:12.916 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:12 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/2933130653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd41049f0 msgr2=0x7f0fd4104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/2933130653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd41049f0 0x7f0fd4104e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009ca0 tx=0x7f0fc402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/2933130653 shutdown_connections 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/2933130653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd410de50 0x7f0fd4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/2933130653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd4105340 0x7f0fd410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/2933130653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd41049f0 0x7f0fd4104e00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/2933130653 >> 172.21.15.28:0/2933130653 conn(0x7f0fd4079750 msgr2=0x7f0fd4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/2933130653 shutdown_connections 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.005+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/2933130653 wait complete. 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 Processor -- start 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 -- start start 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 0x7f0fd4102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:13.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 0x7f0fd4102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4113af0 con 0x7f0fd410de50 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4113970 con 0x7f0fd4105340 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd8c4b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4113c70 con 0x7f0fd41049f0 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 0x7f0fd4102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 0x7f0fd4102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39352/0 (socket says 172.21.15.28:39352) 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 0x7f0fd4102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.28:37468/0 (socket says 172.21.15.28:37468) 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 0x7f0fd4102730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.28:37686/0 (socket says 172.21.15.28:37686) 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.006+0000 7f0fd2d9d640 1 -- 172.21.15.28:0/3792699588 learned_addr learned my addr 172.21.15.28:0/3792699588 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:13.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 -- 172.21.15.28:0/3792699588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 msgr2=0x7f0fd4102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 0x7f0fd4102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 -- 172.21.15.28:0/3792699588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 msgr2=0x7f0fd4102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 0x7f0fd4102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 -- 172.21.15.28:0/3792699588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd41a8760 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd2d9d640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00e970 tx=0x7f0fcc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00ccc0 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fcc00ce60 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd41a8a50 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc010430 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.007+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd41a8f90 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.008+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd4104e00 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.010+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0fcc004f70 con 0x7f0fd410de50 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.011+0000 7f0fcb7fe640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 0x7f0fc00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:13.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.011+0000 7f0fd259c640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 0x7f0fc00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:13.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.011+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f0fcc0e7a60 con 0x7f0fd410de50 2024-09-21T07:05:13.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.012+0000 7f0fd259c640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 0x7f0fc00b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005e30 tx=0x7f0fc4009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:13.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.014+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fcc056710 con 0x7f0fd410de50 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:05:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:12 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-21T07:05:13.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.252+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0fd4103a30 con 0x7f0fd410de50 2024-09-21T07:05:13.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.258+0000 7f0fcb7fe640 1 -- 172.21.15.28:0/3792699588 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296437 (secure 0 0 0) 0x7f0fd4103a30 con 0x7f0fd410de50 2024-09-21T07:05:13.264 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 msgr2=0x7f0fc00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 0x7f0fc00b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005e30 tx=0x7f0fc4009360 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 msgr2=0x7f0fd41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00e970 tx=0x7f0fcc00ed70 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 shutdown_connections 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0fc00b65a0 0x7f0fc00b8ab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fd410de50 0x7f0fd41031b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0fd4105340 0x7f0fd4102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 --2- 172.21.15.28:0/3792699588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fd41049f0 0x7f0fd4102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:13.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 >> 172.21.15.28:0/3792699588 conn(0x7f0fd4079750 msgr2=0x7f0fd40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:13.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 shutdown_connections 2024-09-21T07:05:13.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:13.261+0000 7f0fd8c4b640 1 -- 172.21.15.28:0/3792699588 wait complete. 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:05:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-21T07:05:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2024-09-21T07:05:13.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:12 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-21T07:05:14.088 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2420223587},{"type":"v1","addr":"172.21.15.28:6801","nonce":2420223587}]},"active_addr":"172.21.15.28:6801/2420223587","active_change":"2024-09-21T06:57:12.165003+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24143,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":718156485}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3617854157}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":1276856171}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":1395330537}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":4128932766}]}]} 2024-09-21T07:05:14.095 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:05:14.095 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:05:14.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:05:14.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T07:05:14.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T07:05:14.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:05:14.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:13 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3792699588' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:05:14.121 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T07:05:14.121 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T07:05:14.121 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:05:14.122 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:13 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3792699588' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:05:14.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:05:14.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:13 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3792699588' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:05:14.358 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 -- 172.21.15.28:0/4111867136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38981083c0 msgr2=0x7f38981087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 --2- 172.21.15.28:0/4111867136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38981083c0 0x7f38981087d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f388c009900 tx=0x7f388c02a410 comp rx=0 tx=0).stop 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 -- 172.21.15.28:0/4111867136 shutdown_connections 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 --2- 172.21.15.28:0/4111867136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3898108d10 0x7f389810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 --2- 172.21.15.28:0/4111867136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38981083c0 0x7f38981087d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 --2- 172.21.15.28:0/4111867136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898102a80 0x7f3898102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 -- 172.21.15.28:0/4111867136 >> 172.21.15.28:0/4111867136 conn(0x7f3898079740 msgr2=0x7f3898079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 -- 172.21.15.28:0/4111867136 shutdown_connections 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.835+0000 7f389cb4c640 1 -- 172.21.15.28:0/4111867136 wait complete. 2024-09-21T07:05:14.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 Processor -- start 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 -- start start 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 0x7f389819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898108d10 0x7f389819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3898113aa0 con 0x7f3898102a80 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f3898113920 con 0x7f38981083c0 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.836+0000 7f389cb4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3898113c20 con 0x7f3898108d10 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39372/0 (socket says 172.21.15.28:39372) 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 -- 172.21.15.28:0/2166308317 learned_addr learned my addr 172.21.15.28:0/2166308317 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f3895d9b640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 0x7f389819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f3896d9d640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898108d10 0x7f389819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 -- 172.21.15.28:0/2166308317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898108d10 msgr2=0x7f389819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898108d10 0x7f389819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:14.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 -- 172.21.15.28:0/2166308317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 msgr2=0x7f389819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 0x7f389819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 -- 172.21.15.28:0/2166308317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38981a0300 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f3895d9b640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 0x7f389819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389659c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f388800c920 tx=0x7f388800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007c70 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3888007e10 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981a05f0 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888018820 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.837+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38981a6e10 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.838+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3898103d00 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.840+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f388800f450 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.841+0000 7f38877fe640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 0x7f38800b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.841+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f38880e7910 con 0x7f3898102a80 2024-09-21T07:05:14.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.841+0000 7f3895d9b640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 0x7f38800b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:14.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.841+0000 7f3895d9b640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 0x7f38800b8ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f388c000c00 tx=0x7f388c032da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:14.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:14.844+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3888014030 con 0x7f3898102a80 2024-09-21T07:05:15.000 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:14 smithi028 ceph-mon[31213]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:05:15.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.035+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3898102e90 con 0x7f3898102a80 2024-09-21T07:05:15.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.037+0000 7f38877fe640 1 -- 172.21.15.28:0/2166308317 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7f38880ae0e0 con 0x7f3898102a80 2024-09-21T07:05:15.039 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:15.039 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 msgr2=0x7f38800b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 0x7f38800b8ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f388c000c00 tx=0x7f388c032da0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 msgr2=0x7f389819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f388800c920 tx=0x7f388800cde0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 shutdown_connections 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f38800b65d0 0x7f38800b8ae0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3898108d10 0x7f389819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38981083c0 0x7f389819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 --2- 172.21.15.28:0/2166308317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3898102a80 0x7f389819a450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 >> 172.21.15.28:0/2166308317 conn(0x7f3898079740 msgr2=0x7f38981052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 shutdown_connections 2024-09-21T07:05:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:15.039+0000 7f389cb4c640 1 -- 172.21.15.28:0/2166308317 wait complete. 2024-09-21T07:05:15.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:14 smithi181 ceph-mon[34686]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:05:15.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:14 smithi129 ceph-mon[34863]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:05:15.837 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:05:15.837 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:05:16.134 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:16.255 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:15 smithi028 ceph-mon[31213]: pgmap v305: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:05:16.256 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:15 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2166308317' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:15 smithi181 ceph-mon[34686]: pgmap v305: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:05:16.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:15 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2166308317' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:15 smithi129 ceph-mon[34863]: pgmap v305: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:05:16.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:15 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2166308317' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 -- 172.21.15.28:0/3066032225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac1094a0 msgr2=0x7fa6ac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/3066032225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac1098b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009900 tx=0x7fa6a002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 -- 172.21.15.28:0/3066032225 shutdown_connections 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/3066032225 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac109df0 0x7fa6ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/3066032225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac1098b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/3066032225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac103b60 0x7fa6ac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 -- 172.21.15.28:0/3066032225 >> 172.21.15.28:0/3066032225 conn(0x7fa6ac07b850 msgr2=0x7fa6ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 -- 172.21.15.28:0/3066032225 shutdown_connections 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.657+0000 7fa6b0e15640 1 -- 172.21.15.28:0/3066032225 wait complete. 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 Processor -- start 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 -- start start 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 0x7fa6ac19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac113ab0 con 0x7fa6ac109df0 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac113930 con 0x7fa6ac103b60 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6b0e15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac113c30 con 0x7fa6ac1094a0 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39394/0 (socket says 172.21.15.28:39394) 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 -- 172.21.15.28:0/2548283631 learned_addr learned my addr 172.21.15.28:0/2548283631 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aa59c640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 0x7fa6ac19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6a9d9b640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 -- 172.21.15.28:0/2548283631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac1094a0 msgr2=0x7fa6ac19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 -- 172.21.15.28:0/2548283631 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 msgr2=0x7fa6ac19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 0x7fa6ac19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aad9d640 1 -- 172.21.15.28:0/2548283631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac1a0370 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.658+0000 7fa6aa59c640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 0x7fa6ac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa6aad9d640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400cce0 tx=0x7fa6a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400f450 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6a400faa0 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac1a0660 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4018b70 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.659+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac1a0b20 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.660+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac103f70 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.661+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa6a4018d10 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.662+0000 7fa69b7fe640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 0x7fa6940b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.662+0000 7fa6aa59c640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 0x7fa6940b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.662+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa6a40e7990 con 0x7fa6ac109df0 2024-09-21T07:05:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.663+0000 7fa6aa59c640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 0x7fa6940b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0058c0 tx=0x7fa69c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:16.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.666+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6a4014030 con 0x7fa6ac109df0 2024-09-21T07:05:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.855+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6ac10bbf0 con 0x7fa6ac109df0 2024-09-21T07:05:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.856+0000 7fa69b7fe640 1 -- 172.21.15.28:0/2548283631 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7fa6a40ae0d0 con 0x7fa6ac109df0 2024-09-21T07:05:16.860 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:16.861 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:05:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.858+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 msgr2=0x7fa6940b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.858+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 0x7fa6940b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0058c0 tx=0x7fa69c005850 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.858+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 msgr2=0x7fa6ac19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.858+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400cce0 tx=0x7fa6a400a620 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 shutdown_connections 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa6940b65d0 0x7fa6940b8ae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6ac109df0 0x7fa6ac19fd00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6ac1094a0 0x7fa6ac19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 --2- 172.21.15.28:0/2548283631 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6ac103b60 0x7fa6ac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 >> 172.21.15.28:0/2548283631 conn(0x7fa6ac07b850 msgr2=0x7fa6ac105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 shutdown_connections 2024-09-21T07:05:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:16.859+0000 7fa6b0e15640 1 -- 172.21.15.28:0/2548283631 wait complete. 2024-09-21T07:05:17.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2548283631' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:17.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2548283631' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:17.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2548283631' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:17.693 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:05:17.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:05:17.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:05:17.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:05:17.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:05:17.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:05:17.696 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:05:17.696 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:05:17.697 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:05:17.697 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:05:17.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:05:17.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:05:18.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:17 smithi028 ceph-mon[31213]: pgmap v306: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:18.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:17 smithi181 ceph-mon[34686]: pgmap v306: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:18.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:17 smithi129 ceph-mon[34863]: pgmap v306: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:18.453 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:18.476 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:18.476 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:18.476 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:18.483 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/4006019214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68102a60 msgr2=0x7f6d68102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/4006019214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68102a60 0x7f6d68102e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009900 tx=0x7f6d5802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/4006019214 shutdown_connections 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/4006019214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d68108cf0 0x7f6d6810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/4006019214 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6d681083a0 0x7f6d681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/4006019214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68102a60 0x7f6d68102e70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/4006019214 >> 172.21.15.28:0/4006019214 conn(0x7f6d68079730 msgr2=0x7f6d68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/4006019214 shutdown_connections 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.190+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/4006019214 wait complete. 2024-09-21T07:05:19.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.191+0000 7f6d6e4b1640 1 Processor -- start 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.191+0000 7f6d6e4b1640 1 -- start start 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d68102a60 0x7f6d681a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6d681083a0 0x7f6d681a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 0x7f6d681a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d68112960 con 0x7f6d68108cf0 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f6d681127e0 con 0x7f6d681083a0 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6e4b1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d68112ae0 con 0x7f6d68102a60 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 0x7f6d681a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 0x7f6d681a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39420/0 (socket says 172.21.15.28:39420) 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 -- 172.21.15.28:0/1770124846 learned_addr learned my addr 172.21.15.28:0/1770124846 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d5ffff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6d681083a0 0x7f6d681a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d67fff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d68102a60 0x7f6d681a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 -- 172.21.15.28:0/1770124846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d68102a60 msgr2=0x7f6d681a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d68102a60 0x7f6d681a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 -- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6d681083a0 msgr2=0x7f6d681a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6d681083a0 0x7f6d681a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d681a68f0 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.192+0000 7f6d6ca4e640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 0x7f6d681a6280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000cce0 tx=0x7f6d6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.193+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000f450 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.193+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d681a6be0 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.193+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d6000faa0 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.193+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60018b70 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.193+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d681ad400 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.194+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d681066c0 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.195+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6d60018d10 con 0x7f6d68108cf0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.196+0000 7f6d65ffb640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6d540b65d0 0x7f6d540b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.196+0000 7f6d67fff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6d540b65d0 0x7f6d540b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.196+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6d600e7b10 con 0x7f6d68108cf0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.197+0000 7f6d65ffb640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] conn(0x7f6d540c00c0 0x7f6d540c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.197+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d60012ec0 con 0x7f6d540c00c0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.197+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6d600e7ec0 con 0x7f6d68108cf0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.197+0000 7f6d67fff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6d540b65d0 0x7f6d540b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d58031440 tx=0x7f6d58009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.197+0000 7f6d5ffff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] conn(0x7f6d540c00c0 0x7f6d540c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.198+0000 7f6d5ffff640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] conn(0x7f6d540c00c0 0x7f6d540c25b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.199+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== osd.4 v2:172.21.15.129:6808/3815377982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d60012ec0 con 0x7f6d540c00c0 2024-09-21T07:05:19.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.213+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 --> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d68103ce0 con 0x7f6d540c00c0 2024-09-21T07:05:19.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d65ffb640 1 -- 172.21.15.28:0/1770124846 <== osd.4 v2:172.21.15.129:6808/3815377982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6d68103ce0 con 0x7f6d540c00c0 2024-09-21T07:05:19.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] conn(0x7f6d540c00c0 msgr2=0x7f6d540c25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] conn(0x7f6d540c00c0 0x7f6d540c25b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6d540b65d0 msgr2=0x7f6d540b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6d540b65d0 0x7f6d540b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d58031440 tx=0x7f6d58009560 comp rx=0 tx=0).stop 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 msgr2=0x7f6d681a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 --2- 172.21.15.28:0/1770124846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d68108cf0 0x7f6d681a6280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000cce0 tx=0x7f6d6000a620 comp rx=0 tx=0).stop 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6ca4e640 1 -- 172.21.15.28:0/1770124846 reap_dead start 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 shutdown_connections 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 >> 172.21.15.28:0/1770124846 conn(0x7f6d68079730 msgr2=0x7f6d6806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 shutdown_connections 2024-09-21T07:05:19.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.214+0000 7f6d6e4b1640 1 -- 172.21.15.28:0/1770124846 wait complete. 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 -- 172.21.15.28:0/394875744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 msgr2=0x7fdf401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 --2- 172.21.15.28:0/394875744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf401087b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009900 tx=0x7fdf3402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 -- 172.21.15.28:0/394875744 shutdown_connections 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 --2- 172.21.15.28:0/394875744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 0x7fdf4010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 --2- 172.21.15.28:0/394875744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf401087b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.638+0000 7fdf44fea640 1 --2- 172.21.15.28:0/394875744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf40102a60 0x7fdf40102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.639+0000 7fdf44fea640 1 -- 172.21.15.28:0/394875744 >> 172.21.15.28:0/394875744 conn(0x7fdf40079730 msgr2=0x7fdf40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.639+0000 7fdf44fea640 1 -- 172.21.15.28:0/394875744 shutdown_connections 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.639+0000 7fdf44fea640 1 -- 172.21.15.28:0/394875744 wait complete. 2024-09-21T07:05:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.639+0000 7fdf44fea640 1 Processor -- start 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.639+0000 7fdf44fea640 1 -- start start 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf40102a60 0x7fdf4019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf4019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 0x7fdf4019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40112960 con 0x7fdf401083a0 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401127e0 con 0x7fdf40108cf0 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf44fea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40112ae0 con 0x7fdf40102a60 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf4019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf4019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39428/0 (socket says 172.21.15.28:39428) 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 -- 172.21.15.28:0/1984881732 learned_addr learned my addr 172.21.15.28:0/1984881732 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3e59c640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf40102a60 0x7fdf4019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3ed9d640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 0x7fdf4019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 -- 172.21.15.28:0/1984881732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf40102a60 msgr2=0x7fdf4019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf40102a60 0x7fdf4019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 -- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 msgr2=0x7fdf4019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 0x7fdf4019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3dd9b640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401a0450 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.640+0000 7fdf3ed9d640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf40108cf0 0x7fdf4019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf3dd9b640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf4019aa80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf34032fd0 tx=0x7fdf34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3403f030 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf34004490 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401a06e0 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34035070 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.641+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf401a6ea0 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.642+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf40063b50 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.644+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdf34042030 con 0x7fdf401083a0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.644+0000 7fdf2f7fe640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdf280b6620 0x7fdf280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf3e59c640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdf280b6620 0x7fdf280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdf34107da0 con 0x7fdf401083a0 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf2f7fe640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] conn(0x7fdf280c0110 0x7fdf280c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf280c2cd0 con 0x7fdf280c0110 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fdf341081f0 con 0x7fdf401083a0 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf3e59c640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdf280b6620 0x7fdf280b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000bbe0 tx=0x7fdf3000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.645+0000 7fdf3ed9d640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] conn(0x7fdf280c0110 0x7fdf280c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.646+0000 7fdf3ed9d640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] conn(0x7fdf280c0110 0x7fdf280c2600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.647+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== osd.7 v2:172.21.15.129:6816/3154062983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf280c2cd0 con 0x7fdf280c0110 2024-09-21T07:05:19.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.663+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 --> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf40063f50 con 0x7fdf280c0110 2024-09-21T07:05:19.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.664+0000 7fdf2f7fe640 1 -- 172.21.15.28:0/1984881732 <== osd.7 v2:172.21.15.129:6816/3154062983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf40063f50 con 0x7fdf280c0110 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.664+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] conn(0x7fdf280c0110 msgr2=0x7fdf280c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.664+0000 7fdf44fea640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] conn(0x7fdf280c0110 0x7fdf280c2600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdf280b6620 msgr2=0x7fdf280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdf280b6620 0x7fdf280b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000bbe0 tx=0x7fdf3000b390 comp rx=0 tx=0).stop 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 msgr2=0x7fdf4019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 --2- 172.21.15.28:0/1984881732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf401083a0 0x7fdf4019aa80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf34032fd0 tx=0x7fdf34004270 comp rx=0 tx=0).stop 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf3ed9d640 1 -- 172.21.15.28:0/1984881732 reap_dead start 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 shutdown_connections 2024-09-21T07:05:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 >> 172.21.15.28:0/1984881732 conn(0x7fdf40079730 msgr2=0x7fdf4006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:19.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 shutdown_connections 2024-09-21T07:05:19.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:19.665+0000 7fdf44fea640 1 -- 172.21.15.28:0/1984881732 wait complete. 2024-09-21T07:05:20.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:19 smithi028 ceph-mon[31213]: pgmap v307: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:20.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:19 smithi181 ceph-mon[34686]: pgmap v307: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:20.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:19 smithi129 ceph-mon[34863]: pgmap v307: 97 pgs: 1 activating, 3 peering, 93 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:20.677 INFO:teuthology.orchestra.run.smithi028.stdout:188978561066 2024-09-21T07:05:20.677 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T07:05:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 -- 172.21.15.28:0/2093451227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41041083c0 msgr2=0x7f41041087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 --2- 172.21.15.28:0/2093451227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41041083c0 0x7f41041087d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009ca0 tx=0x7f40f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 -- 172.21.15.28:0/2093451227 shutdown_connections 2024-09-21T07:05:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 --2- 172.21.15.28:0/2093451227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 0x7f410410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 --2- 172.21.15.28:0/2093451227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41041083c0 0x7f41041087d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 --2- 172.21.15.28:0/2093451227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4104102a80 0x7f4104102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 -- 172.21.15.28:0/2093451227 >> 172.21.15.28:0/2093451227 conn(0x7f4104079740 msgr2=0x7f4104079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 -- 172.21.15.28:0/2093451227 shutdown_connections 2024-09-21T07:05:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.955+0000 7f41090b7640 1 -- 172.21.15.28:0/2093451227 wait complete. 2024-09-21T07:05:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.956+0000 7f41090b7640 1 Processor -- start 2024-09-21T07:05:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 -- start start 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 0x7f410419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41041083c0 0x7f410419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 0x7f410419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4104112980 con 0x7f4104102a80 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4104112800 con 0x7f4104108d10 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f41090b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4104112b00 con 0x7f41041083c0 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f4102d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 0x7f410419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f4102d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 0x7f410419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39454/0 (socket says 172.21.15.28:39454) 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f4102d9d640 1 -- 172.21.15.28:0/1310194123 learned_addr learned my addr 172.21.15.28:0/1310194123 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f410259c640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41041083c0 0x7f410419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.957+0000 7f410359e640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 0x7f410419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 -- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41041083c0 msgr2=0x7f410419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41041083c0 0x7f410419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 -- 172.21.15.28:0/1310194123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 msgr2=0x7f410419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 0x7f410419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a6610 con 0x7f4104102a80 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f410359e640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4104108d10 0x7f410419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f4102d9d640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 0x7f410419b390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c920 tx=0x7f40f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4007c70 con 0x7f4104102a80 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41041a6900 con 0x7f4104102a80 2024-09-21T07:05:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f4007e10 con 0x7f4104102a80 2024-09-21T07:05:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4018820 con 0x7f4104102a80 2024-09-21T07:05:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.958+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a6e60 con 0x7f4104102a80 2024-09-21T07:05:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.959+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4104063ad0 con 0x7f4104102a80 2024-09-21T07:05:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.962+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f40f40189c0 con 0x7f4104102a80 2024-09-21T07:05:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f40ebfff640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f40ec0b65a0 0x7f40ec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f410259c640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f40ec0b65a0 0x7f40ec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f40f40e7c50 con 0x7f4104102a80 2024-09-21T07:05:20.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f40ebfff640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] conn(0x7f40ec0c0090 0x7f40ec0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40f4023e50 con 0x7f40ec0c0090 2024-09-21T07:05:20.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.963+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f40f40e8000 con 0x7f4104102a80 2024-09-21T07:05:20.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.964+0000 7f410259c640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f40ec0b65a0 0x7f40ec0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098d0 tx=0x7f40f80093e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:20.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.964+0000 7f410359e640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] conn(0x7f40ec0c0090 0x7f40ec0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.964+0000 7f410359e640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] conn(0x7f40ec0c0090 0x7f40ec0c2580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:20.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.965+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== osd.5 v2:172.21.15.181:6808/2730863123 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40f4023e50 con 0x7f40ec0c0090 2024-09-21T07:05:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.980+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 --> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4104063f00 con 0x7f40ec0c0090 2024-09-21T07:05:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.980+0000 7f40ebfff640 1 -- 172.21.15.28:0/1310194123 <== osd.5 v2:172.21.15.181:6808/2730863123 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4104063f00 con 0x7f40ec0c0090 2024-09-21T07:05:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] conn(0x7f40ec0c0090 msgr2=0x7f40ec0c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] conn(0x7f40ec0c0090 0x7f40ec0c2580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f40ec0b65a0 msgr2=0x7f40ec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f40ec0b65a0 0x7f40ec0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098d0 tx=0x7f40f80093e0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 msgr2=0x7f410419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 --2- 172.21.15.28:0/1310194123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4104102a80 0x7f410419b390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c920 tx=0x7f40f400cde0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f410359e640 1 -- 172.21.15.28:0/1310194123 reap_dead start 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 shutdown_connections 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 >> 172.21.15.28:0/1310194123 conn(0x7f4104079740 msgr2=0x7f41041045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 shutdown_connections 2024-09-21T07:05:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:20.981+0000 7f41090b7640 1 -- 172.21.15.28:0/1310194123 wait complete. 2024-09-21T07:05:21.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 -- 172.21.15.28:0/416864496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 msgr2=0x7fab28103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 --2- 172.21.15.28:0/416864496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab28103f70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fab24009900 tx=0x7fab2402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 -- 172.21.15.28:0/416864496 shutdown_connections 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 --2- 172.21.15.28:0/416864496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab28109df0 0x7fab28110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 --2- 172.21.15.28:0/416864496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab281094a0 0x7fab281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 --2- 172.21.15.28:0/416864496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab28103f70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 -- 172.21.15.28:0/416864496 >> 172.21.15.28:0/416864496 conn(0x7fab2807b850 msgr2=0x7fab2807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 -- 172.21.15.28:0/416864496 shutdown_connections 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 -- 172.21.15.28:0/416864496 wait complete. 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.806+0000 7fab2ff43640 1 Processor -- start 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 -- start start 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab2819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab281094a0 0x7fab2819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab28109df0 0x7fab2819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab28113b10 con 0x7fab28103b60 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fab28113990 con 0x7fab28109df0 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2ff43640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fab28113c90 con 0x7fab281094a0 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab2819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab2819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39472/0 (socket says 172.21.15.28:39472) 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 -- 172.21.15.28:0/2648439248 learned_addr learned my addr 172.21.15.28:0/2648439248 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2d4de640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab281094a0 0x7fab2819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2e4e0640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab28109df0 0x7fab2819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 -- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab281094a0 msgr2=0x7fab2819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab281094a0 0x7fab2819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 -- 172.21.15.28:0/2648439248 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab28109df0 msgr2=0x7fab2819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab28109df0 0x7fab2819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2dcdf640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab281a0430 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.807+0000 7fab2e4e0640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fab28109df0 0x7fab2819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab2dcdf640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab2819a580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab24006010 tx=0x7fab240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2403f030 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab24003800 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24035070 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab281a06c0 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.808+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab281a0ba0 con 0x7fab28103b60 2024-09-21T07:05:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.809+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab28063b50 con 0x7fab28103b60 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.811+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fab24003cb0 con 0x7fab28103b60 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.811+0000 7fab1effd640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab140b65d0 0x7fab140b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab2d4de640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab140b65d0 0x7fab140b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab24108560 con 0x7fab28103b60 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab1effd640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] conn(0x7fab140c00c0 0x7fab140c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab24044e50 con 0x7fab140c00c0 2024-09-21T07:05:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fab241089b0 con 0x7fab28103b60 2024-09-21T07:05:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab2d4de640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab140b65d0 0x7fab140b8ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab18005e10 tx=0x7fab18005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.812+0000 7fab2e4e0640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] conn(0x7fab140c00c0 0x7fab140c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.813+0000 7fab2e4e0640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] conn(0x7fab140c00c0 0x7fab140c25b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.813+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== osd.2 v2:172.21.15.181:6800/1137940490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab24044e50 con 0x7fab140c00c0 2024-09-21T07:05:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.829+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 --> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab28063fd0 con 0x7fab140c00c0 2024-09-21T07:05:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab1effd640 1 -- 172.21.15.28:0/2648439248 <== osd.2 v2:172.21.15.181:6800/1137940490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab28063fd0 con 0x7fab140c00c0 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] conn(0x7fab140c00c0 msgr2=0x7fab140c25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] conn(0x7fab140c00c0 0x7fab140c25b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab140b65d0 msgr2=0x7fab140b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab140b65d0 0x7fab140b8ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab18005e10 tx=0x7fab18005da0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 msgr2=0x7fab2819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 --2- 172.21.15.28:0/2648439248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28103b60 0x7fab2819a580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab24006010 tx=0x7fab240042f0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2e4e0640 1 -- 172.21.15.28:0/2648439248 reap_dead start 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 shutdown_connections 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 >> 172.21.15.28:0/2648439248 conn(0x7fab2807b850 msgr2=0x7fab28107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 shutdown_connections 2024-09-21T07:05:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:21.830+0000 7fab2ff43640 1 -- 172.21.15.28:0/2648439248 wait complete. 2024-09-21T07:05:21.957 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:21 smithi028 ceph-mon[31213]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:22.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:21 smithi181 ceph-mon[34686]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:22.312 INFO:teuthology.orchestra.run.smithi028.stdout:120259084345 2024-09-21T07:05:22.312 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:05:22.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:21 smithi129 ceph-mon[34863]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:22.799 INFO:teuthology.orchestra.run.smithi028.stdout:141733920820 2024-09-21T07:05:22.799 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:05:23.393 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.395 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.397 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.400 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.400 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.401 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.404 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.457 INFO:teuthology.orchestra.run.smithi028.stdout:73014444100 2024-09-21T07:05:23.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:05:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:23.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:23 smithi028 ceph-mon[31213]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 542 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:24.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:23 smithi181 ceph-mon[34686]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 542 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:24.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:23 smithi129 ceph-mon[34863]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 542 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:05:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 -- 172.21.15.28:0/3159122416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e58103b90 msgr2=0x7f9e58103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/3159122416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e58103b90 0x7f9e58103fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009900 tx=0x7f9e5402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 -- 172.21.15.28:0/3159122416 shutdown_connections 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/3159122416 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e58109e20 0x7f9e58110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/3159122416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e581094d0 0x7f9e581098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/3159122416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e58103b90 0x7f9e58103fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 -- 172.21.15.28:0/3159122416 >> 172.21.15.28:0/3159122416 conn(0x7f9e580ff600 msgr2=0x7f9e58101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 -- 172.21.15.28:0/3159122416 shutdown_connections 2024-09-21T07:05:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.749+0000 7f9e5f85e640 1 -- 172.21.15.28:0/3159122416 wait complete. 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.750+0000 7f9e5f85e640 1 Processor -- start 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.750+0000 7f9e5f85e640 1 -- start start 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e58103b90 0x7f9e58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 0x7f9e58075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e58109e20 0x7f9e58076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113ae0 con 0x7f9e581094d0 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113960 con 0x7f9e58109e20 2024-09-21T07:05:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5f85e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113c60 con 0x7f9e58103b90 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 0x7f9e58075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 0x7f9e58075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33342/0 (socket says 172.21.15.28:33342) 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 -- 172.21.15.28:0/4236578301 learned_addr learned my addr 172.21.15.28:0/4236578301 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5ddfb640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e58109e20 0x7f9e58076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 -- 172.21.15.28:0/4236578301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e58103b90 msgr2=0x7f9e58075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e58103b90 0x7f9e58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 -- 172.21.15.28:0/4236578301 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e58109e20 msgr2=0x7f9e58076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9e58109e20 0x7f9e58076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e581a8730 con 0x7f9e581094d0 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.751+0000 7f9e5cdf9640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 0x7f9e58075c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800e9c0 tx=0x7f9e4800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.752+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800ccc0 con 0x7f9e581094d0 2024-09-21T07:05:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.752+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e480054d0 con 0x7f9e581094d0 2024-09-21T07:05:24.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.752+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e581a8a20 con 0x7f9e581094d0 2024-09-21T07:05:24.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.752+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48010430 con 0x7f9e581094d0 2024-09-21T07:05:24.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.752+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e581a8f00 con 0x7f9e581094d0 2024-09-21T07:05:24.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.753+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e58063b50 con 0x7f9e581094d0 2024-09-21T07:05:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.755+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e48005000 con 0x7f9e581094d0 2024-09-21T07:05:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.756+0000 7f9e4e7fc640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e440b6620 0x7f9e440b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.756+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e480e7cc0 con 0x7f9e581094d0 2024-09-21T07:05:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e5d5fa640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e440b6620 0x7f9e440b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e4e7fc640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] conn(0x7f9e440c0110 0x7f9e440c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e48009030 con 0x7f9e440c0110 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f9e480e8110 con 0x7f9e581094d0 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e5ddfb640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] conn(0x7f9e440c0110 0x7f9e440c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.757+0000 7f9e5d5fa640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e440b6620 0x7f9e440b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e5402a930 tx=0x7f9e54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.758+0000 7f9e5ddfb640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] conn(0x7f9e440c0110 0x7f9e440c2600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.758+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== osd.3 v2:172.21.15.28:6810/1190124716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e48009030 con 0x7f9e440c0110 2024-09-21T07:05:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.773+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 --> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e58063fd0 con 0x7f9e440c0110 2024-09-21T07:05:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.773+0000 7f9e4e7fc640 1 -- 172.21.15.28:0/4236578301 <== osd.3 v2:172.21.15.28:6810/1190124716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e58063fd0 con 0x7f9e440c0110 2024-09-21T07:05:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] conn(0x7f9e440c0110 msgr2=0x7f9e440c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] conn(0x7f9e440c0110 0x7f9e440c2600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e440b6620 msgr2=0x7f9e440b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e440b6620 0x7f9e440b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e5402a930 tx=0x7f9e54031400 comp rx=0 tx=0).stop 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 msgr2=0x7f9e58075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 --2- 172.21.15.28:0/4236578301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e581094d0 0x7f9e58075c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800e9c0 tx=0x7f9e4800ee80 comp rx=0 tx=0).stop 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5ddfb640 1 -- 172.21.15.28:0/4236578301 reap_dead start 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 shutdown_connections 2024-09-21T07:05:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 >> 172.21.15.28:0/4236578301 conn(0x7f9e580ff600 msgr2=0x7f9e58101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 shutdown_connections 2024-09-21T07:05:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:24.774+0000 7f9e5f85e640 1 -- 172.21.15.28:0/4236578301 wait complete. 2024-09-21T07:05:25.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 -- 172.21.15.28:0/1753725989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7554105330 msgr2=0x7f755410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 --2- 172.21.15.28:0/1753725989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7554105330 0x7f755410d880 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f753c009900 tx=0x7f753c02a410 comp rx=0 tx=0).stop 2024-09-21T07:05:25.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 -- 172.21.15.28:0/1753725989 shutdown_connections 2024-09-21T07:05:25.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 --2- 172.21.15.28:0/1753725989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f755410de40 0x7f7554110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 --2- 172.21.15.28:0/1753725989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7554105330 0x7f755410d880 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 --2- 172.21.15.28:0/1753725989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75541049e0 0x7f7554104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 -- 172.21.15.28:0/1753725989 >> 172.21.15.28:0/1753725989 conn(0x7f7554079750 msgr2=0x7f7554079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 -- 172.21.15.28:0/1753725989 shutdown_connections 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 -- 172.21.15.28:0/1753725989 wait complete. 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.313+0000 7f755a379640 1 Processor -- start 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 -- start start 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75541049e0 0x7f755419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7554105330 0x7f755419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 0x7f755419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7554113aa0 con 0x7f755410de40 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7554113920 con 0x7f7554105330 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f755a379640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7554113c20 con 0x7f75541049e0 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 0x7f755419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 0x7f755419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33364/0 (socket says 172.21.15.28:33364) 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 -- 172.21.15.28:0/1488919856 learned_addr learned my addr 172.21.15.28:0/1488919856 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7553fff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75541049e0 0x7f755419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f754bfff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7554105330 0x7f755419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 -- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75541049e0 msgr2=0x7f755419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75541049e0 0x7f755419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 -- 172.21.15.28:0/1488919856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7554105330 msgr2=0x7f755419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7554105330 0x7f755419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75541a0420 con 0x7f755410de40 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.314+0000 7f7558916640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 0x7f755419fdb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f754c00cce0 tx=0x7f754c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.315+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c00f450 con 0x7f755410de40 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.315+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75541a0710 con 0x7f755410de40 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.315+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f754c00faa0 con 0x7f755410de40 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.315+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c018b70 con 0x7f755410de40 2024-09-21T07:05:25.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.315+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75541a0bd0 con 0x7f755410de40 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.316+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7554063b10 con 0x7f755410de40 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.317+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f754c018d10 con 0x7f755410de40 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7551ffb640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f75400b65d0 0x7f75400b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7553fff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f75400b65d0 0x7f75400b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f754c0e7ad0 con 0x7f755410de40 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7551ffb640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] conn(0x7f75400c00c0 0x7f75400c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f754c012ec0 con 0x7f75400c00c0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.318+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f754c0e7f20 con 0x7f755410de40 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.319+0000 7f7553fff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f75400b65d0 0x7f75400b8ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75440058c0 tx=0x7f754400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.319+0000 7f754bfff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] conn(0x7f75400c00c0 0x7f75400c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.319+0000 7f754bfff640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] conn(0x7f75400c00c0 0x7f75400c25b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.320+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== osd.8 v2:172.21.15.181:6816/2560474309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f754c012ec0 con 0x7f75400c00c0 2024-09-21T07:05:25.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.333+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 --> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7554063f90 con 0x7f75400c00c0 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.334+0000 7f7551ffb640 1 -- 172.21.15.28:0/1488919856 <== osd.8 v2:172.21.15.181:6816/2560474309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7554063f90 con 0x7f75400c00c0 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.334+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] conn(0x7f75400c00c0 msgr2=0x7f75400c25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.334+0000 7f755a379640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] conn(0x7f75400c00c0 0x7f75400c25b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f75400b65d0 msgr2=0x7f75400b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f75400b65d0 0x7f75400b8ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75440058c0 tx=0x7f754400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 msgr2=0x7f755419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 --2- 172.21.15.28:0/1488919856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f755410de40 0x7f755419fdb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f754c00cce0 tx=0x7f754c00a620 comp rx=0 tx=0).stop 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f7558916640 1 -- 172.21.15.28:0/1488919856 reap_dead start 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 shutdown_connections 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 >> 172.21.15.28:0/1488919856 conn(0x7f7554079750 msgr2=0x7f75540ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 shutdown_connections 2024-09-21T07:05:25.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.335+0000 7f755a379640 1 -- 172.21.15.28:0/1488919856 wait complete. 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 -- 172.21.15.28:0/1202042714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 msgr2=0x7fb4d4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/1202042714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d4103f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009900 tx=0x7fb4d002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 -- 172.21.15.28:0/1202042714 shutdown_connections 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/1202042714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 0x7fb4d4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/1202042714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 0x7fb4d41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/1202042714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d4103f70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 -- 172.21.15.28:0/1202042714 >> 172.21.15.28:0/1202042714 conn(0x7fb4d407b850 msgr2=0x7fb4d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 -- 172.21.15.28:0/1202042714 shutdown_connections 2024-09-21T07:05:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.759+0000 7fb4db8f8640 1 -- 172.21.15.28:0/1202042714 wait complete. 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 Processor -- start 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 -- start start 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 0x7fb4d419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 0x7fb4d419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4113ab0 con 0x7fb4d4103b60 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4113930 con 0x7fb4d41094a0 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4db8f8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4113c30 con 0x7fb4d4109df0 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4d9694640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.760+0000 7fb4d9694640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33392/0 (socket says 172.21.15.28:33392) 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 -- 172.21.15.28:0/3127678919 learned_addr learned my addr 172.21.15.28:0/3127678919 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:25.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d8e93640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 0x7fb4d419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9e95640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 0x7fb4d419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 -- 172.21.15.28:0/3127678919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 msgr2=0x7fb4d419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 0x7fb4d419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 -- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 msgr2=0x7fb4d419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 0x7fb4d419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d41a0490 con 0x7fb4d4103b60 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9e95640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d4109df0 0x7fb4d419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d8e93640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4d41094a0 0x7fb4d419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4d9694640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d419a520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005940 tx=0x7fb4d00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d003f030 con 0x7fb4d4103b60 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d00044c0 con 0x7fb4d4103b60 2024-09-21T07:05:25.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d41a0720 con 0x7fb4d4103b60 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0035070 con 0x7fb4d4103b60 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.761+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d41a6ee0 con 0x7fb4d4103b60 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.762+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4d4063b50 con 0x7fb4d4103b60 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.764+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb4d0042030 con 0x7fb4d4103b60 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4ca7fc640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb4c00b6620 0x7fb4c00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4d8e93640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb4c00b6620 0x7fb4c00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb4d0107ff0 con 0x7fb4d4103b60 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4ca7fc640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] conn(0x7fb4c00c0110 0x7fb4c00c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4c00c2cd0 con 0x7fb4c00c0110 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fb4d01083a0 con 0x7fb4d4103b60 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4d8e93640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb4c00b6620 0x7fb4c00b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4109200 tx=0x7fb4c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.765+0000 7fb4d9e95640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] conn(0x7fb4c00c0110 0x7fb4c00c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.766+0000 7fb4d9e95640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] conn(0x7fb4c00c0110 0x7fb4c00c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:25.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.767+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== osd.1 v2:172.21.15.129:6800/1501531235 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb4c00c2cd0 con 0x7fb4c00c0110 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.780+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 --> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4d4063f50 con 0x7fb4c00c0110 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4ca7fc640 1 -- 172.21.15.28:0/3127678919 <== osd.1 v2:172.21.15.129:6800/1501531235 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4d4063f50 con 0x7fb4c00c0110 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] conn(0x7fb4c00c0110 msgr2=0x7fb4c00c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] conn(0x7fb4c00c0110 0x7fb4c00c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb4c00b6620 msgr2=0x7fb4c00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb4c00b6620 0x7fb4c00b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4109200 tx=0x7fb4c4005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 msgr2=0x7fb4d419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 --2- 172.21.15.28:0/3127678919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4d4103b60 0x7fb4d419a520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005940 tx=0x7fb4d00040c0 comp rx=0 tx=0).stop 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4d9e95640 1 -- 172.21.15.28:0/3127678919 reap_dead start 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 shutdown_connections 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 >> 172.21.15.28:0/3127678919 conn(0x7fb4d407b850 msgr2=0x7fb4d4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.781+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 shutdown_connections 2024-09-21T07:05:25.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:25.782+0000 7fb4db8f8640 1 -- 172.21.15.28:0/3127678919 wait complete. 2024-09-21T07:05:26.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:25 smithi028 ceph-mon[31213]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 490 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:26.159 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:25 smithi129 ceph-mon[34863]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 490 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:26.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:25 smithi181 ceph-mon[34686]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 490 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:26.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 -- 172.21.15.28:0/687417711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c0108d10 msgr2=0x7fb5c010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 --2- 172.21.15.28:0/687417711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c0108d10 0x7fb5c010f540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009ca0 tx=0x7fb5b802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 -- 172.21.15.28:0/687417711 shutdown_connections 2024-09-21T07:05:26.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 --2- 172.21.15.28:0/687417711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c0108d10 0x7fb5c010f540 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 --2- 172.21.15.28:0/687417711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5c01083c0 0x7fb5c01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 --2- 172.21.15.28:0/687417711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0102a80 0x7fb5c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 -- 172.21.15.28:0/687417711 >> 172.21.15.28:0/687417711 conn(0x7fb5c0079740 msgr2=0x7fb5c0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 -- 172.21.15.28:0/687417711 shutdown_connections 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.333+0000 7fb5c7934640 1 -- 172.21.15.28:0/687417711 wait complete. 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 Processor -- start 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 -- start start 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5c0102a80 0x7fb5c019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 0x7fb5c019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0108d10 0x7fb5c019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01129e0 con 0x7fb5c01083c0 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0112860 con 0x7fb5c0102a80 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c7934640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0112b60 con 0x7fb5c0108d10 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 0x7fb5c019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 0x7fb5c019aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33432/0 (socket says 172.21.15.28:33432) 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 -- 172.21.15.28:0/2630024577 learned_addr learned my addr 172.21.15.28:0/2630024577 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c5ed1640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0108d10 0x7fb5c019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c56d0640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5c0102a80 0x7fb5c019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 -- 172.21.15.28:0/2630024577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0108d10 msgr2=0x7fb5c019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0108d10 0x7fb5c019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 -- 172.21.15.28:0/2630024577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5c0102a80 msgr2=0x7fb5c019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5c0102a80 0x7fb5c019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c4ecf640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c01a0470 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.334+0000 7fb5c5ed1640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5c0108d10 0x7fb5c019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5c4ecf640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 0x7fb5c019aaa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0005fd0 tx=0x7fb5b000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0017070 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c01a0760 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b000de50 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0003c20 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.335+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c01a6ec0 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.336+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5c0105330 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.337+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb5b0003dc0 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5b67fc640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5ac0b65a0 0x7fb5ac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5c56d0640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5ac0b65a0 0x7fb5ac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5b00e7580 con 0x7fb5c01083c0 2024-09-21T07:05:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5b67fc640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] conn(0x7fb5ac0c0090 0x7fb5ac0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5b001de50 con 0x7fb5ac0c0090 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.338+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fb5b00e79d0 con 0x7fb5c01083c0 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.339+0000 7fb5c5ed1640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] conn(0x7fb5ac0c0090 0x7fb5ac0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.339+0000 7fb5c56d0640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5ac0b65a0 0x7fb5ac0b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009990 tx=0x7fb5bc009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.339+0000 7fb5c5ed1640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] conn(0x7fb5ac0c0090 0x7fb5ac0c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.340+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== osd.0 v2:172.21.15.28:6802/394219256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5b001de50 con 0x7fb5ac0c0090 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.353+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 --> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5c006b390 con 0x7fb5ac0c0090 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5b67fc640 1 -- 172.21.15.28:0/2630024577 <== osd.0 v2:172.21.15.28:6802/394219256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5c006b390 con 0x7fb5ac0c0090 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] conn(0x7fb5ac0c0090 msgr2=0x7fb5ac0c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] conn(0x7fb5ac0c0090 0x7fb5ac0c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5ac0b65a0 msgr2=0x7fb5ac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5ac0b65a0 0x7fb5ac0b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009990 tx=0x7fb5bc009110 comp rx=0 tx=0).stop 2024-09-21T07:05:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 msgr2=0x7fb5c019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 --2- 172.21.15.28:0/2630024577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5c01083c0 0x7fb5c019aaa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0005fd0 tx=0x7fb5b000dd20 comp rx=0 tx=0).stop 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c5ed1640 1 -- 172.21.15.28:0/2630024577 reap_dead start 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 shutdown_connections 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 >> 172.21.15.28:0/2630024577 conn(0x7fb5c0079740 msgr2=0x7fb5c0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 shutdown_connections 2024-09-21T07:05:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.354+0000 7fb5c7934640 1 -- 172.21.15.28:0/2630024577 wait complete. 2024-09-21T07:05:27.152 INFO:teuthology.orchestra.run.smithi028.stdout:55834574922 2024-09-21T07:05:27.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:05:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 -- 172.21.15.28:0/2129607943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af0104a60 msgr2=0x7f5af0104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 --2- 172.21.15.28:0/2129607943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af0104a60 0x7f5af0104e70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009900 tx=0x7f5ae002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 -- 172.21.15.28:0/2129607943 shutdown_connections 2024-09-21T07:05:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 --2- 172.21.15.28:0/2129607943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 0x7f5af01103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 --2- 172.21.15.28:0/2129607943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af01053b0 0x7f5af010d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 --2- 172.21.15.28:0/2129607943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af0104a60 0x7f5af0104e70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 -- 172.21.15.28:0/2129607943 >> 172.21.15.28:0/2129607943 conn(0x7f5af00796d0 msgr2=0x7f5af0079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 -- 172.21.15.28:0/2129607943 shutdown_connections 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.220+0000 7f5af66bb640 1 -- 172.21.15.28:0/2129607943 wait complete. 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.221+0000 7f5af66bb640 1 Processor -- start 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.221+0000 7f5af66bb640 1 -- start start 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af0104a60 0x7f5af019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 0x7f5af019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 0x7f5af019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0113ba0 con 0x7f5af01053b0 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0113a20 con 0x7f5af0104a60 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0113d20 con 0x7f5af010dec0 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 0x7f5af019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 0x7f5af019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33414/0 (socket says 172.21.15.28:33414) 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 -- 172.21.15.28:0/3549363111 learned_addr learned my addr 172.21.15.28:0/3549363111 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aeffff640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af0104a60 0x7f5af019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af4c58640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 0x7f5af019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 -- 172.21.15.28:0/3549363111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 msgr2=0x7f5af019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 0x7f5af019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 -- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af0104a60 msgr2=0x7f5af019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af0104a60 0x7f5af019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01a04e0 con 0x7f5af01053b0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aeffff640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5af0104a60 0x7f5af019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af4c58640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af010dec0 0x7f5af019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aef7fe640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 0x7f5af019abd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400c8c0 tx=0x7f5ae400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007bb0 con 0x7f5af01053b0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.222+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af01a07d0 con 0x7f5af01053b0 2024-09-21T07:05:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.223+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ae4007d50 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.223+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40187c0 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.223+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af01a6ff0 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.223+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5af01072b0 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.225+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5ae400fa20 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aed7fa640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ad80b65d0 0x7f5ad80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aeffff640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ad80b65d0 0x7f5ad80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5ae40e7c20 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aed7fa640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] conn(0x7f5ad80c00c0 0x7f5ad80c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ae4011ec0 con 0x7f5ad80c00c0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.226+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f5ae40e8070 con 0x7f5af01053b0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.227+0000 7f5aeffff640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ad80b65d0 0x7f5ad80b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0031440 tx=0x7f5ae0005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.227+0000 7f5af4c58640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] conn(0x7f5ad80c00c0 0x7f5ad80c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.227+0000 7f5af4c58640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] conn(0x7f5ad80c00c0 0x7f5ad80c25b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.228+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== osd.10 v2:172.21.15.129:6824/3634135642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ae4011ec0 con 0x7f5ad80c00c0 2024-09-21T07:05:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.244+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 --> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5af006c260 con 0x7f5ad80c00c0 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.245+0000 7f5aed7fa640 1 -- 172.21.15.28:0/3549363111 <== osd.10 v2:172.21.15.129:6824/3634135642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5af006c260 con 0x7f5ad80c00c0 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.245+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] conn(0x7f5ad80c00c0 msgr2=0x7f5ad80c25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.245+0000 7f5af66bb640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] conn(0x7f5ad80c00c0 0x7f5ad80c25b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ad80b65d0 msgr2=0x7f5ad80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f5ad80b65d0 0x7f5ad80b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0031440 tx=0x7f5ae0005d50 comp rx=0 tx=0).stop 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 msgr2=0x7f5af019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 --2- 172.21.15.28:0/3549363111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5af01053b0 0x7f5af019abd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400c8c0 tx=0x7f5ae400cd80 comp rx=0 tx=0).stop 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af4c58640 1 -- 172.21.15.28:0/3549363111 reap_dead start 2024-09-21T07:05:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 shutdown_connections 2024-09-21T07:05:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 >> 172.21.15.28:0/3549363111 conn(0x7f5af00796d0 msgr2=0x7f5af01068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 shutdown_connections 2024-09-21T07:05:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:26.246+0000 7f5af66bb640 1 -- 172.21.15.28:0/3549363111 wait complete. 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.775+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2327760560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 msgr2=0x7f88cc110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.775+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2327760560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc110640 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009ca0 tx=0x7f88c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2327760560 shutdown_connections 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2327760560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc110640 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2327760560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 0x7f88cc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2327760560 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc103b80 0x7f88cc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2327760560 >> 172.21.15.28:0/2327760560 conn(0x7f88cc0ff610 msgr2=0x7f88cc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2327760560 shutdown_connections 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2327760560 wait complete. 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 Processor -- start 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.776+0000 7f88d2cf1640 1 -- start start 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc103b80 0x7f88cc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 0x7f88cc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc113ad0 con 0x7f88cc109e10 2024-09-21T07:05:27.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc113950 con 0x7f88cc103b80 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d2cf1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc113c50 con 0x7f88cc1094c0 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33458/0 (socket says 172.21.15.28:33458) 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 -- 172.21.15.28:0/2954159592 learned_addr learned my addr 172.21.15.28:0/2954159592 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88cbfff640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 0x7f88cc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d0a8d640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc103b80 0x7f88cc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 -- 172.21.15.28:0/2954159592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 msgr2=0x7f88cc19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 0x7f88cc19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 -- 172.21.15.28:0/2954159592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc103b80 msgr2=0x7f88cc19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc103b80 0x7f88cc19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc1a0450 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88cbfff640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88cc1094c0 0x7f88cc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.777+0000 7f88d128e640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc19fd20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88c40098d0 tx=0x7f88c40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.778+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4003b70 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.778+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88c4003d10 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.778+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc1a06e0 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.778+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c402fa20 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.778+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc1a6ea0 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.779+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88cc063ad0 con 0x7f88cc109e10 2024-09-21T07:05:27.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.780+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f88c402fbe0 con 0x7f88cc109e10 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.781+0000 7f88c9ffb640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f88b40b6620 0x7f88b40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.781+0000 7f88d0a8d640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f88b40b6620 0x7f88b40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.781+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f88c4108be0 con 0x7f88cc109e10 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.781+0000 7f88c9ffb640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] conn(0x7f88b40c0110 0x7f88b40c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.782+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88b40c2cd0 con 0x7f88b40c0110 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.782+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f88c4108f90 con 0x7f88cc109e10 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.782+0000 7f88cbfff640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] conn(0x7f88b40c0110 0x7f88b40c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.782+0000 7f88d0a8d640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f88b40b6620 0x7f88b40b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009b60 tx=0x7f88bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.782+0000 7f88cbfff640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] conn(0x7f88b40c0110 0x7f88b40c2600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:27.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.783+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== osd.9 v2:172.21.15.28:6826/1426799166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88b40c2cd0 con 0x7f88b40c0110 2024-09-21T07:05:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.798+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 --> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88cc063f00 con 0x7f88b40c0110 2024-09-21T07:05:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.798+0000 7f88c9ffb640 1 -- 172.21.15.28:0/2954159592 <== osd.9 v2:172.21.15.28:6826/1426799166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f88cc063f00 con 0x7f88b40c0110 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.798+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] conn(0x7f88b40c0110 msgr2=0x7f88b40c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.798+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] conn(0x7f88b40c0110 0x7f88b40c2600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f88b40b6620 msgr2=0x7f88b40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f88b40b6620 0x7f88b40b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009b60 tx=0x7f88bc005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 msgr2=0x7f88cc19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 --2- 172.21.15.28:0/2954159592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88cc109e10 0x7f88cc19fd20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88c40098d0 tx=0x7f88c40317b0 comp rx=0 tx=0).stop 2024-09-21T07:05:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d128e640 1 -- 172.21.15.28:0/2954159592 reap_dead start 2024-09-21T07:05:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 shutdown_connections 2024-09-21T07:05:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 >> 172.21.15.28:0/2954159592 conn(0x7f88cc0ff610 msgr2=0x7f88cc107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 shutdown_connections 2024-09-21T07:05:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:27.799+0000 7f88d2cf1640 1 -- 172.21.15.28:0/2954159592 wait complete. 2024-09-21T07:05:28.045 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:27 smithi028 ceph-mon[31213]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:28.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:27 smithi181 ceph-mon[34686]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:28.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:27 smithi129 ceph-mon[34863]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 -- 172.21.15.28:0/2479496661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 msgr2=0x7fd360103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 --2- 172.21.15.28:0/2479496661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360103fc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd350009ca0 tx=0x7fd35002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 -- 172.21.15.28:0/2479496661 shutdown_connections 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 --2- 172.21.15.28:0/2479496661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd360109e40 0x7fd360110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 --2- 172.21.15.28:0/2479496661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3601094f0 0x7fd360109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 --2- 172.21.15.28:0/2479496661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360103fc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 -- 172.21.15.28:0/2479496661 >> 172.21.15.28:0/2479496661 conn(0x7fd3600ff600 msgr2=0x7fd360101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 -- 172.21.15.28:0/2479496661 shutdown_connections 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.828+0000 7fd364ca3640 1 -- 172.21.15.28:0/2479496661 wait complete. 2024-09-21T07:05:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 Processor -- start 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 -- start start 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3601094f0 0x7fd360075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd360109e40 0x7fd360076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd360113b00 con 0x7fd360103bb0 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd360113980 con 0x7fd3601094f0 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd364ca3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd360113c80 con 0x7fd360109e40 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33506/0 (socket says 172.21.15.28:33506) 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.829+0000 7fd35e59c640 1 -- 172.21.15.28:0/3995094523 learned_addr learned my addr 172.21.15.28:0/3995094523 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35dd9b640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3601094f0 0x7fd360075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35ed9d640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd360109e40 0x7fd360076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 -- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd360109e40 msgr2=0x7fd360076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd360109e40 0x7fd360076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 -- 172.21.15.28:0/3995094523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3601094f0 msgr2=0x7fd360075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3601094f0 0x7fd360075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3601a87b0 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35dd9b640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3601094f0 0x7fd360075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd35e59c640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd350006010 tx=0x7fd3500319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350003bf0 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd350003d90 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3601a8a40 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35002fc20 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.830+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3601a8f80 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.831+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd360063b50 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.833+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd3500046a0 con 0x7fd360103bb0 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd3577fe640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd34c0b65a0 0x7fd34c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:28.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd35dd9b640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd34c0b65a0 0x7fd34c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd350108bc0 con 0x7fd360103bb0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd3577fe640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] conn(0x7fd34c0c0090 0x7fd34c0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd34c0c2c50 con 0x7fd34c0c0090 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fd350108f70 con 0x7fd360103bb0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.834+0000 7fd35dd9b640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd34c0b65a0 0x7fd34c0b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd360109050 tx=0x7fd348005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.835+0000 7fd35ed9d640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] conn(0x7fd34c0c0090 0x7fd34c0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.835+0000 7fd35ed9d640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] conn(0x7fd34c0c0090 0x7fd34c0c2580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.836+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== osd.11 v2:172.21.15.181:6824/3397668181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd34c0c2c50 con 0x7fd34c0c0090 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.850+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 --> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd360063fd0 con 0x7fd34c0c0090 2024-09-21T07:05:28.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.850+0000 7fd3577fe640 1 -- 172.21.15.28:0/3995094523 <== osd.11 v2:172.21.15.181:6824/3397668181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd360063fd0 con 0x7fd34c0c0090 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] conn(0x7fd34c0c0090 msgr2=0x7fd34c0c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] conn(0x7fd34c0c0090 0x7fd34c0c2580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd34c0b65a0 msgr2=0x7fd34c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd34c0b65a0 0x7fd34c0b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd360109050 tx=0x7fd348005ec0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 msgr2=0x7fd360075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:28.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 --2- 172.21.15.28:0/3995094523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd360103bb0 0x7fd360075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd350006010 tx=0x7fd3500319f0 comp rx=0 tx=0).stop 2024-09-21T07:05:28.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd35ed9d640 1 -- 172.21.15.28:0/3995094523 reap_dead start 2024-09-21T07:05:28.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 shutdown_connections 2024-09-21T07:05:28.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 >> 172.21.15.28:0/3995094523 conn(0x7fd3600ff600 msgr2=0x7fd360101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:28.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 shutdown_connections 2024-09-21T07:05:28.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.851+0000 7fd364ca3640 1 -- 172.21.15.28:0/3995094523 wait complete. 2024-09-21T07:05:29.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:28 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1481273639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:05:29.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:28 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1481273639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:05:29.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:28 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1481273639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:05:29.525 INFO:teuthology.orchestra.run.smithi028.stdout:283467841559 2024-09-21T07:05:29.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 -- 172.21.15.28:0/3173503436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004108cf0 msgr2=0x7fb00410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/3173503436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004108cf0 0x7fb00410f520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faffc009ca0 tx=0x7faffc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 -- 172.21.15.28:0/3173503436 shutdown_connections 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/3173503436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004108cf0 0x7fb00410f520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/3173503436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0041083a0 0x7fb0041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/3173503436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004102a60 0x7fb004102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 -- 172.21.15.28:0/3173503436 >> 172.21.15.28:0/3173503436 conn(0x7fb004079730 msgr2=0x7fb004079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 -- 172.21.15.28:0/3173503436 shutdown_connections 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 -- 172.21.15.28:0/3173503436 wait complete. 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.500+0000 7fb00a0fe640 1 Processor -- start 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 -- start start 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb004102a60 0x7fb004199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004108cf0 0x7fb00419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb004112960 con 0x7fb0041083a0 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb0041127e0 con 0x7fb004102a60 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb00a0fe640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb004112ae0 con 0x7fb004108cf0 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33474/0 (socket says 172.21.15.28:33474) 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 -- 172.21.15.28:0/1481273639 learned_addr learned my addr 172.21.15.28:0/1481273639 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:29.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb0037fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb004102a60 0x7fb004199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb003fff640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004108cf0 0x7fb00419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stdout:188978561067 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 -- 172.21.15.28:0/1481273639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004108cf0 msgr2=0x7fb00419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004108cf0 0x7fb00419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 -- 172.21.15.28:0/1481273639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb004102a60 msgr2=0x7fb004199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb004102a60 0x7fb004199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.501+0000 7fb002ffd640 1 -- 172.21.15.28:0/1481273639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00419f280 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb002ffd640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faff800d770 tx=0x7faff800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8017070 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff8009c30 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff800f620 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00419f570 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.502+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0041a5cd0 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.503+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004102e70 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.504+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faff801a070 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.505+0000 7fb000ff9640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 0x7fafec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.505+0000 7fb0037fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 0x7fafec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.505+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faff80e6fe0 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.506+0000 7fb0037fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 0x7fafec0b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faff4009bd0 tx=0x7faff4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.510+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faff8009de0 con 0x7fb0041083a0 2024-09-21T07:05:29.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.705+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb00410a530 con 0x7fb0041083a0 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.705+0000 7fb000ff9640 1 -- 172.21.15.28:0/1481273639 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faff80ad720 con 0x7fb0041083a0 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 msgr2=0x7fafec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 0x7fafec0b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faff4009bd0 tx=0x7faff4005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 msgr2=0x7fb0041998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faff800d770 tx=0x7faff800dc30 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 shutdown_connections 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.707+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fafec0b65a0 0x7fafec0b8ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb004108cf0 0x7fb00419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0041083a0 0x7fb0041998b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 --2- 172.21.15.28:0/1481273639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb004102a60 0x7fb004199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 >> 172.21.15.28:0/1481273639 conn(0x7fb004079730 msgr2=0x7fb0041043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 shutdown_connections 2024-09-21T07:05:29.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.708+0000 7fb00a0fe640 1 -- 172.21.15.28:0/1481273639 wait complete. 2024-09-21T07:05:30.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:29 smithi028 ceph-mon[31213]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T07:05:30.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:29 smithi181 ceph-mon[34686]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T07:05:30.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:29 smithi129 ceph-mon[34863]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T07:05:30.455 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561066 got 188978561067 for osd.7 2024-09-21T07:05:30.455 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:31.503 INFO:teuthology.orchestra.run.smithi028.stdout:210453397541 2024-09-21T07:05:31.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T07:05:32.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:31 smithi028 ceph-mon[31213]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T07:05:32.085 INFO:teuthology.orchestra.run.smithi028.stdout:236223201312 2024-09-21T07:05:32.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T07:05:32.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:31 smithi181 ceph-mon[34686]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T07:05:32.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:31 smithi129 ceph-mon[34863]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T07:05:32.653 INFO:teuthology.orchestra.run.smithi028.stdout:257698037788 2024-09-21T07:05:32.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:05:32.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 -- 172.21.15.28:0/235160878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc109e00 msgr2=0x7f3fdc110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/235160878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc109e00 0x7f3fdc110630 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009ca0 tx=0x7f3fd402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 -- 172.21.15.28:0/235160878 shutdown_connections 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/235160878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc109e00 0x7f3fdc110630 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/235160878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/235160878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fdc103bc0 0x7f3fdc103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 -- 172.21.15.28:0/235160878 >> 172.21.15.28:0/235160878 conn(0x7f3fdc07b910 msgr2=0x7f3fdc07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 -- 172.21.15.28:0/235160878 shutdown_connections 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.608+0000 7f3fe26ff640 1 -- 172.21.15.28:0/235160878 wait complete. 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 Processor -- start 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 -- start start 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc103bc0 0x7f3fdc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:32.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fdc109e00 0x7f3fdc19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc113ac0 con 0x7f3fdc1094b0 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc113940 con 0x7f3fdc109e00 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.609+0000 7f3fe26ff640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc113c40 con 0x7f3fdc103bc0 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33488/0 (socket says 172.21.15.28:33488) 2024-09-21T07:05:32.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 -- 172.21.15.28:0/404605259 learned_addr learned my addr 172.21.15.28:0/404605259 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fe0c9c640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fdc109e00 0x7f3fdc19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdbfff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc103bc0 0x7f3fdc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 -- 172.21.15.28:0/404605259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc103bc0 msgr2=0x7f3fdc19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc103bc0 0x7f3fdc19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 -- 172.21.15.28:0/404605259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fdc109e00 msgr2=0x7f3fdc19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3fdc109e00 0x7f3fdc19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc1a0280 con 0x7f3fdc1094b0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdbfff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fdc103bc0 0x7f3fdc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fdb7fe640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc19a970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c8c0 tx=0x7f3fd000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0007bb0 con 0x7f3fdc1094b0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fd0007d50 con 0x7f3fdc1094b0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc1a0570 con 0x7f3fdc1094b0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00187c0 con 0x7f3fdc1094b0 2024-09-21T07:05:32.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.610+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc1a6d90 con 0x7f3fdc1094b0 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.611+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fdc063b50 con 0x7f3fdc1094b0 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.614+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3fd000fa20 con 0x7f3fdc1094b0 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fd97fa640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fc40b6650 0x7f3fc40b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fdbfff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fc40b6650 0x7f3fc40b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3fd00e7c10 con 0x7f3fdc1094b0 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fd97fa640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] conn(0x7f3fc40c0140 0x7f3fc40c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fd001ee50 con 0x7f3fc40c0140 2024-09-21T07:05:32.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3fd00e8060 con 0x7f3fdc1094b0 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fdbfff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fc40b6650 0x7f3fc40b8b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009b50 tx=0x7f3fcc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.615+0000 7f3fe0c9c640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] conn(0x7f3fc40c0140 0x7f3fc40c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.616+0000 7f3fe0c9c640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] conn(0x7f3fc40c0140 0x7f3fc40c2630 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.616+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== osd.6 v2:172.21.15.28:6818/462044654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fd001ee50 con 0x7f3fc40c0140 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.630+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 --> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fdc063f50 con 0x7f3fc40c0140 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.630+0000 7f3fd97fa640 1 -- 172.21.15.28:0/404605259 <== osd.6 v2:172.21.15.28:6818/462044654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3fdc063f50 con 0x7f3fc40c0140 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] conn(0x7f3fc40c0140 msgr2=0x7f3fc40c2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] conn(0x7f3fc40c0140 0x7f3fc40c2630 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fc40b6650 msgr2=0x7f3fc40b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fc40b6650 0x7f3fc40b8b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009b50 tx=0x7f3fcc005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 msgr2=0x7f3fdc19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 --2- 172.21.15.28:0/404605259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3fdc1094b0 0x7f3fdc19a970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c8c0 tx=0x7f3fd000cd80 comp rx=0 tx=0).stop 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe0c9c640 1 -- 172.21.15.28:0/404605259 reap_dead start 2024-09-21T07:05:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 shutdown_connections 2024-09-21T07:05:32.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 >> 172.21.15.28:0/404605259 conn(0x7f3fdc07b910 msgr2=0x7f3fdc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:32.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 shutdown_connections 2024-09-21T07:05:32.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:28.631+0000 7f3fe26ff640 1 -- 172.21.15.28:0/404605259 wait complete. 2024-09-21T07:05:33.555 INFO:teuthology.orchestra.run.smithi028.stdout:167503724592 2024-09-21T07:05:33.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:05:34.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:33 smithi028 ceph-mon[31213]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:34.140 INFO:teuthology.orchestra.run.smithi028.stdout:34359738447 2024-09-21T07:05:34.140 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:05:34.258 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.261 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:33 smithi181 ceph-mon[34686]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:34.270 INFO:teuthology.orchestra.run.smithi028.stdout:98784247871 2024-09-21T07:05:34.270 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:05:34.334 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:33 smithi129 ceph-mon[34863]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:34.377 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.589 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.590 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:34.590 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 -- 172.21.15.28:0/155820948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e01094b0 msgr2=0x7f44e01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 --2- 172.21.15.28:0/155820948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e01094b0 0x7f44e01098c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009900 tx=0x7f44d402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 -- 172.21.15.28:0/155820948 shutdown_connections 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 --2- 172.21.15.28:0/155820948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e0109e00 0x7f44e0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 --2- 172.21.15.28:0/155820948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e01094b0 0x7f44e01098c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 --2- 172.21.15.28:0/155820948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0101f70 0x7f44e0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 -- 172.21.15.28:0/155820948 >> 172.21.15.28:0/155820948 conn(0x7f44e0077c60 msgr2=0x7f44e00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 -- 172.21.15.28:0/155820948 shutdown_connections 2024-09-21T07:05:35.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.374+0000 7f44e8717640 1 -- 172.21.15.28:0/155820948 wait complete. 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 Processor -- start 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 -- start start 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 0x7f44e019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 0x7f44e01a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113ac0 con 0x7f44e0101f70 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113940 con 0x7f44e0109e00 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e8717640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113c40 con 0x7f44e01094b0 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e64b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e64b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53300/0 (socket says 172.21.15.28:53300) 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e64b3640 1 -- 172.21.15.28:0/133621374 learned_addr learned my addr 172.21.15.28:0/133621374 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.375+0000 7f44e6cb4640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 0x7f44e01a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e5cb2640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 0x7f44e019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 -- 172.21.15.28:0/133621374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 msgr2=0x7f44e019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 0x7f44e019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 -- 172.21.15.28:0/133621374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 msgr2=0x7f44e01a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 0x7f44e01a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 -- 172.21.15.28:0/133621374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e01a25e0 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e6cb4640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 0x7f44e01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e5cb2640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 0x7f44e019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44e64b3640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44d000ebc0 tx=0x7f44d000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0010630 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.376+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d0010c80 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.377+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0018b60 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.377+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e01a28d0 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.377+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a9030 con 0x7f44e0101f70 2024-09-21T07:05:35.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.377+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e0102380 con 0x7f44e0101f70 2024-09-21T07:05:35.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.379+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f44d0018d00 con 0x7f44e0101f70 2024-09-21T07:05:35.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.380+0000 7f44df7fe640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 0x7f44c80b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.380+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f44d00e7f90 con 0x7f44e0101f70 2024-09-21T07:05:35.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.381+0000 7f44e5cb2640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 0x7f44c80b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.382+0000 7f44e5cb2640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 0x7f44c80b8bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009230 tx=0x7f44d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:35.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.386+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44d00ae670 con 0x7f44e0101f70 2024-09-21T07:05:35.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.591+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f44e019d7a0 con 0x7f44e0101f70 2024-09-21T07:05:35.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.592+0000 7f44df7fe640 1 -- 172.21.15.28:0/133621374 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44e019d7a0 con 0x7f44e0101f70 2024-09-21T07:05:35.594 INFO:teuthology.orchestra.run.smithi028.stdout:55834574923 2024-09-21T07:05:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 msgr2=0x7f44c80b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 0x7f44c80b8bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009230 tx=0x7f44d4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 msgr2=0x7f44e019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44d000ebc0 tx=0x7f44d000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 shutdown_connections 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f44c80b66a0 0x7f44c80b8bb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44e0109e00 0x7f44e01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44e01094b0 0x7f44e019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 --2- 172.21.15.28:0/133621374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f44e0101f70 0x7f44e019c670 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 >> 172.21.15.28:0/133621374 conn(0x7f44e0077c60 msgr2=0x7f44e01072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 shutdown_connections 2024-09-21T07:05:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.594+0000 7f44e8717640 1 -- 172.21.15.28:0/133621374 wait complete. 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.871+0000 7fdb2eaef640 1 -- 172.21.15.28:0/2363080861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28109e20 msgr2=0x7fdb28110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.871+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/2363080861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28109e20 0x7fdb28110650 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009ca0 tx=0x7fdb2002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 -- 172.21.15.28:0/2363080861 shutdown_connections 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/2363080861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28109e20 0x7fdb28110650 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/2363080861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb281094d0 0x7fdb281098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/2363080861 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28103b90 0x7fdb28103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 -- 172.21.15.28:0/2363080861 >> 172.21.15.28:0/2363080861 conn(0x7fdb280ff600 msgr2=0x7fdb28101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 -- 172.21.15.28:0/2363080861 shutdown_connections 2024-09-21T07:05:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 -- 172.21.15.28:0/2363080861 wait complete. 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 Processor -- start 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.872+0000 7fdb2eaef640 1 -- start start 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb28103b90 0x7fdb28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 0x7fdb28076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28113ae0 con 0x7fdb281094d0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28113960 con 0x7fdb28109e20 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2eaef640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28113c60 con 0x7fdb28103b90 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2d08c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 0x7fdb28076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53318/0 (socket says 172.21.15.28:53318) 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb2d08c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 0x7fdb28076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.28:40464/0 (socket says 172.21.15.28:40464) 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 -- 172.21.15.28:0/3946239331 learned_addr learned my addr 172.21.15.28:0/3946239331 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 -- 172.21.15.28:0/3946239331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb28103b90 msgr2=0x7fdb28075710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb28103b90 0x7fdb28075710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 -- 172.21.15.28:0/3946239331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 msgr2=0x7fdb28076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 0x7fdb28076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.873+0000 7fdb27fff640 1 -- 172.21.15.28:0/3946239331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb281a8660 con 0x7fdb281094d0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb27fff640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c8c0 tx=0x7fdb1400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14007bb0 con 0x7fdb281094d0 2024-09-21T07:05:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb281a8950 con 0x7fdb281094d0 2024-09-21T07:05:35.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb14007d50 con 0x7fdb281094d0 2024-09-21T07:05:35.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140187c0 con 0x7fdb281094d0 2024-09-21T07:05:35.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.874+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb281a8e90 con 0x7fdb281094d0 2024-09-21T07:05:35.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.875+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb28103fa0 con 0x7fdb281094d0 2024-09-21T07:05:35.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.878+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdb1400fa20 con 0x7fdb281094d0 2024-09-21T07:05:35.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.879+0000 7fdb25ffb640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 0x7fdb180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:35.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.879+0000 7fdb2c88b640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 0x7fdb180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:35.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.879+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdb140e77e0 con 0x7fdb281094d0 2024-09-21T07:05:35.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.880+0000 7fdb2c88b640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 0x7fdb180b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c005fd0 tx=0x7fdb1c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:35.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.883+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb14014030 con 0x7fdb281094d0 2024-09-21T07:05:35.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:35 smithi028 ceph-mon[31213]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:35.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:35 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:35.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3406557155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:05:35.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:35 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/133621374' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 -- 172.21.15.28:0/3715682738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0108cf0 msgr2=0x7fbaf010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/3715682738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0108cf0 0x7fbaf010f520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009ca0 tx=0x7fbae802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 -- 172.21.15.28:0/3715682738 shutdown_connections 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/3715682738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0108cf0 0x7fbaf010f520 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/3715682738 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 0x7fbaf01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/3715682738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0102a60 0x7fbaf0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 -- 172.21.15.28:0/3715682738 >> 172.21.15.28:0/3715682738 conn(0x7fbaf0079730 msgr2=0x7fbaf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 -- 172.21.15.28:0/3715682738 shutdown_connections 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.047+0000 7fbaf5e52640 1 -- 172.21.15.28:0/3715682738 wait complete. 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 Processor -- start 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 -- start start 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 0x7fbaf0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112960 con 0x7fbaf0102a60 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01127e0 con 0x7fbaf01083a0 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaf5e52640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112ae0 con 0x7fbaf0108cf0 2024-09-21T07:05:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.048+0000 7fbaef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53346/0 (socket says 172.21.15.28:53346) 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 -- 172.21.15.28:0/2777289100 learned_addr learned my addr 172.21.15.28:0/2777289100 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaeffff640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaeeffd640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 0x7fbaf0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 -- 172.21.15.28:0/2777289100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0108cf0 msgr2=0x7fbaf019da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 -- 172.21.15.28:0/2777289100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 msgr2=0x7fbaf0198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 0x7fbaf0198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 -- 172.21.15.28:0/2777289100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf019e130 con 0x7fbaf0102a60 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaef7fe640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9f0 tx=0x7fbae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae000cd80 con 0x7fbaf0102a60 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae00054d0 con 0x7fbaf0102a60 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf019e3c0 con 0x7fbaf0102a60 2024-09-21T07:05:36.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0010690 con 0x7fbaf0102a60 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.049+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf019eb70 con 0x7fbaf0102a60 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.050+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf0102e70 con 0x7fbaf0102a60 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.052+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbae0004e90 con 0x7fbaf0102a60 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.053+0000 7fbaecff9640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 0x7fbad80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.053+0000 7fbaeeffd640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 0x7fbad80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.053+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbae00e7800 con 0x7fbaf0102a60 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.053+0000 7fbaeeffd640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 0x7fbad80b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbaf006a3e0 tx=0x7fbae4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:36.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.057+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbae00adf40 con 0x7fbaf0102a60 2024-09-21T07:05:36.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.081+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdb2802e640 con 0x7fdb281094d0 2024-09-21T07:05:36.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.082+0000 7fdb25ffb640 1 -- 172.21.15.28:0/3946239331 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb140adfb0 con 0x7fdb281094d0 2024-09-21T07:05:36.083 INFO:teuthology.orchestra.run.smithi028.stdout:120259084348 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 msgr2=0x7fdb180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 0x7fdb180b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c005fd0 tx=0x7fdb1c005c70 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 msgr2=0x7fdb28075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c8c0 tx=0x7fdb1400cd80 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 shutdown_connections 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fdb180b65a0 0x7fdb180b8ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdb28109e20 0x7fdb28076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb281094d0 0x7fdb28075c50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 --2- 172.21.15.28:0/3946239331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb28103b90 0x7fdb28075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.084+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 >> 172.21.15.28:0/3946239331 conn(0x7fdb280ff600 msgr2=0x7fdb28106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.085+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 shutdown_connections 2024-09-21T07:05:36.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.085+0000 7fdb2eaef640 1 -- 172.21.15.28:0/3946239331 wait complete. 2024-09-21T07:05:36.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:35 smithi129 ceph-mon[34863]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:36.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:35 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:36.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3406557155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:05:36.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:35 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/133621374' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:05:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.256+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbaf019ee60 con 0x7fbaf0102a60 2024-09-21T07:05:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.257+0000 7fbaecff9640 1 -- 172.21.15.28:0/2777289100 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbae00b2320 con 0x7fbaf0102a60 2024-09-21T07:05:36.258 INFO:teuthology.orchestra.run.smithi028.stdout:141733920823 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 msgr2=0x7fbad80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 0x7fbad80b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbaf006a3e0 tx=0x7fbae4005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 msgr2=0x7fbaf01981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9f0 tx=0x7fbae000edf0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 shutdown_connections 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbad80b6620 0x7fbad80b8b30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbaf01083a0 0x7fbaf0198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 --2- 172.21.15.28:0/2777289100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbaf0102a60 0x7fbaf01981c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 >> 172.21.15.28:0/2777289100 conn(0x7fbaf0079730 msgr2=0x7fbaf006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 shutdown_connections 2024-09-21T07:05:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:36.259+0000 7fbaf5e52640 1 -- 172.21.15.28:0/2777289100 wait complete. 2024-09-21T07:05:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:35 smithi181 ceph-mon[34686]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:35 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3406557155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:05:36.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:35 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/133621374' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 -- 172.21.15.28:0/2260867651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9108103b80 msgr2=0x7f9108103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 --2- 172.21.15.28:0/2260867651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9108103b80 0x7f9108103f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009900 tx=0x7f90f802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 -- 172.21.15.28:0/2260867651 shutdown_connections 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 --2- 172.21.15.28:0/2260867651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108109e10 0x7f9108110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 --2- 172.21.15.28:0/2260867651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91081094c0 0x7f91081098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 --2- 172.21.15.28:0/2260867651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9108103b80 0x7f9108103f90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 -- 172.21.15.28:0/2260867651 >> 172.21.15.28:0/2260867651 conn(0x7f91080ff610 msgr2=0x7f9108101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 -- 172.21.15.28:0/2260867651 shutdown_connections 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.291+0000 7f910e404640 1 -- 172.21.15.28:0/2260867651 wait complete. 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 Processor -- start 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 -- start start 2024-09-21T07:05:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 0x7f910819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9108109e10 0x7f910819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9108113ad0 con 0x7f91081094c0 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9108113950 con 0x7f9108103b80 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.292+0000 7f910e404640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9108113c50 con 0x7f9108109e10 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f91077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 0x7f910819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f91077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53282/0 (socket says 172.21.15.28:53282) 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f91077fe640 1 -- 172.21.15.28:0/3406557155 learned_addr learned my addr 172.21.15.28:0/3406557155 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f910c9a1640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9108109e10 0x7f910819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 -- 172.21.15.28:0/3406557155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9108109e10 msgr2=0x7f910819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9108109e10 0x7f910819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stdout:73014444103 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 -- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 msgr2=0x7f910819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 -- 172.21.15.28:0/3406557155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91081a0430 con 0x7f9108103b80 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f91077fe640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.293+0000 7f9107fff640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 0x7f910819a4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006010 tx=0x7f90f8004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.294+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f803f070 con 0x7f9108103b80 2024-09-21T07:05:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.294+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91081a06c0 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.294+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90f8003ca0 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.294+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8035070 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.294+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91081a6e80 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.295+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9108104e00 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.297+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f90f80037f0 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.298+0000 7f91057fa640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 0x7f90f00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.298+0000 7f91077fe640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 0x7f90f00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.298+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f90f8107920 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.299+0000 7f91077fe640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 0x7f90f00b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9108108e50 tx=0x7f90fc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.303+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90f80d23e0 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.523+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f910810b650 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.524+0000 7f91057fa640 1 -- 172.21.15.28:0/3406557155 <== mon.2 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f90f80d7320 con 0x7f9108103b80 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 msgr2=0x7f90f00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 0x7f90f00b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9108108e50 tx=0x7f90fc00b390 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 msgr2=0x7f910819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 0x7f910819a4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006010 tx=0x7f90f8004060 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 shutdown_connections 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f90f00b65a0 0x7f90f00b8ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9108109e10 0x7f910819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91081094c0 0x7f910819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 --2- 172.21.15.28:0/3406557155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9108103b80 0x7f910819a4c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 >> 172.21.15.28:0/3406557155 conn(0x7f91080ff610 msgr2=0x7f9108101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 shutdown_connections 2024-09-21T07:05:36.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:35.526+0000 7f910e404640 1 -- 172.21.15.28:0/3406557155 wait complete. 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3946239331' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2777289100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:36 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444100 got 73014444103 for osd.2 2024-09-21T07:05:37.133 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:37.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3946239331' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:05:37.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2777289100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:05:37.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:36 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3946239331' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:05:37.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2777289100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:05:37.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:36 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:37.815 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084345 got 120259084348 for osd.4 2024-09-21T07:05:37.815 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:38.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:37 smithi028 ceph-mon[31213]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:38.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:37 smithi181 ceph-mon[34686]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:38.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:37 smithi129 ceph-mon[34863]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:38.592 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574923 for osd.1 2024-09-21T07:05:38.592 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 -- 172.21.15.28:0/3988657657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc1094a0 msgr2=0x7f4cdc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3988657657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc1098b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009900 tx=0x7f4cd002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 -- 172.21.15.28:0/3988657657 shutdown_connections 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3988657657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc109df0 0x7f4cdc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3988657657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc1098b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3988657657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc103b60 0x7f4cdc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.130+0000 7f4ce2173640 1 -- 172.21.15.28:0/3988657657 >> 172.21.15.28:0/3988657657 conn(0x7f4cdc07b850 msgr2=0x7f4cdc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:39.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.131+0000 7f4ce2173640 1 -- 172.21.15.28:0/3988657657 shutdown_connections 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.131+0000 7f4ce2173640 1 -- 172.21.15.28:0/3988657657 wait complete. 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.131+0000 7f4ce2173640 1 Processor -- start 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.131+0000 7f4ce2173640 1 -- start start 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 0x7f4cdc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc113ab0 con 0x7f4cdc103b60 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc113930 con 0x7f4cdc109df0 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4ce2173640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc113c30 con 0x7f4cdc1094a0 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53364/0 (socket says 172.21.15.28:53364) 2024-09-21T07:05:39.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 -- 172.21.15.28:0/3766544748 learned_addr learned my addr 172.21.15.28:0/3766544748 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdaffd640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdbfff640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 0x7f4cdc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 -- 172.21.15.28:0/3766544748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc1094a0 msgr2=0x7f4cdc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 -- 172.21.15.28:0/3766544748 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 msgr2=0x7f4cdc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 0x7f4cdc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 -- 172.21.15.28:0/3766544748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1a0490 con 0x7f4cdc103b60 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdbfff640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 0x7f4cdc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.132+0000 7f4cdb7fe640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c890 tx=0x7f4ccc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.133+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004220 con 0x7f4cdc103b60 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.133+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc1a0780 con 0x7f4cdc103b60 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.133+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc0043c0 con 0x7f4cdc103b60 2024-09-21T07:05:39.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.133+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc1a6ee0 con 0x7f4cdc103b60 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.133+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004a00 con 0x7f4cdc103b60 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.134+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc103f70 con 0x7f4cdc103b60 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.135+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4ccc004ba0 con 0x7f4cdc103b60 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.136+0000 7f4cd8ff9640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 0x7f4cc40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.136+0000 7f4cdaffd640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 0x7f4cc40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.136+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4ccc0e7270 con 0x7f4cdc103b60 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.137+0000 7f4cdaffd640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 0x7f4cc40b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009230 tx=0x7f4cd0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:39.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.141+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ccc014030 con 0x7f4cdc103b60 2024-09-21T07:05:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.332+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f4cdc19b650 con 0x7f4cdc103b60 2024-09-21T07:05:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.333+0000 7f4cd8ff9640 1 -- 172.21.15.28:0/3766544748 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4ccc0ad950 con 0x7f4cdc103b60 2024-09-21T07:05:39.334 INFO:teuthology.orchestra.run.smithi028.stdout:283467841561 2024-09-21T07:05:39.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 msgr2=0x7f4cc40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 0x7f4cc40b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009230 tx=0x7f4cd0031400 comp rx=0 tx=0).stop 2024-09-21T07:05:39.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 msgr2=0x7f4cdc19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c890 tx=0x7f4ccc00cd50 comp rx=0 tx=0).stop 2024-09-21T07:05:39.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 shutdown_connections 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4cc40b65a0 0x7f4cc40b8ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4cdc109df0 0x7f4cdc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cdc1094a0 0x7f4cdc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 --2- 172.21.15.28:0/3766544748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cdc103b60 0x7f4cdc19a520 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 >> 172.21.15.28:0/3766544748 conn(0x7f4cdc07b850 msgr2=0x7f4cdc1075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 shutdown_connections 2024-09-21T07:05:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.335+0000 7f4ce2173640 1 -- 172.21.15.28:0/3766544748 wait complete. 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 -- 172.21.15.28:0/3523696062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c1083d0 msgr2=0x7efc7c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 --2- 172.21.15.28:0/3523696062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c1083d0 0x7efc7c1087e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc70009900 tx=0x7efc7002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 -- 172.21.15.28:0/3523696062 shutdown_connections 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 --2- 172.21.15.28:0/3523696062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 0x7efc7c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 --2- 172.21.15.28:0/3523696062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c1083d0 0x7efc7c1087e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 --2- 172.21.15.28:0/3523696062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c102ae0 0x7efc7c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.384+0000 7efc82011640 1 -- 172.21.15.28:0/3523696062 >> 172.21.15.28:0/3523696062 conn(0x7efc7c079760 msgr2=0x7efc7c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.385+0000 7efc82011640 1 -- 172.21.15.28:0/3523696062 shutdown_connections 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.385+0000 7efc82011640 1 -- 172.21.15.28:0/3523696062 wait complete. 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.385+0000 7efc82011640 1 Processor -- start 2024-09-21T07:05:39.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 -- start start 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c1083d0 0x7efc7c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 0x7efc7c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113ab0 con 0x7efc7c102ae0 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113930 con 0x7efc7c108d20 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc82011640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113c30 con 0x7efc7c1083d0 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53376/0 (socket says 172.21.15.28:53376) 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 -- 172.21.15.28:0/4199710349 learned_addr learned my addr 172.21.15.28:0/4199710349 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7bfff640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 0x7efc7c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7affd640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c1083d0 0x7efc7c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 -- 172.21.15.28:0/4199710349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c1083d0 msgr2=0x7efc7c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c1083d0 0x7efc7c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 -- 172.21.15.28:0/4199710349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 msgr2=0x7efc7c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 0x7efc7c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.386+0000 7efc7b7fe640 1 -- 172.21.15.28:0/4199710349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c1a0410 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc7b7fe640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d950 tx=0x7efc6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c017070 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c1a0700 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc6c009c30 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00f620 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.387+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c1a6e60 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.388+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c103d10 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.390+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efc6c005030 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.390+0000 7efc78ff9640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 0x7efc640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.390+0000 7efc7affd640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 0x7efc640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.391+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efc6c0e7090 con 0x7efc7c102ae0 2024-09-21T07:05:39.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.391+0000 7efc7affd640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 0x7efc640b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c00 tx=0x7efc70031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:39.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.394+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc6c0ad7d0 con 0x7efc7c102ae0 2024-09-21T07:05:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.582+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7efc7c19b5d0 con 0x7efc7c102ae0 2024-09-21T07:05:39.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.582+0000 7efc78ff9640 1 -- 172.21.15.28:0/4199710349 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc7c19b5d0 con 0x7efc7c102ae0 2024-09-21T07:05:39.585 INFO:teuthology.orchestra.run.smithi028.stdout:210453397544 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 msgr2=0x7efc640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 0x7efc640b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c00 tx=0x7efc70031400 comp rx=0 tx=0).stop 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 msgr2=0x7efc7c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d950 tx=0x7efc6c00de10 comp rx=0 tx=0).stop 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 shutdown_connections 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7efc640b65a0 0x7efc640b8ab0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc7c108d20 0x7efc7c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c1083d0 0x7efc7c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 --2- 172.21.15.28:0/4199710349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7c102ae0 0x7efc7c19a4a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 >> 172.21.15.28:0/4199710349 conn(0x7efc7c079760 msgr2=0x7efc7c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 shutdown_connections 2024-09-21T07:05:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:39.585+0000 7efc82011640 1 -- 172.21.15.28:0/4199710349 wait complete. 2024-09-21T07:05:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.054+0000 7f9cd038f640 1 -- 172.21.15.28:0/3133097894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 msgr2=0x7f9cc8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.054+0000 7f9cd038f640 1 --2- 172.21.15.28:0/3133097894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8108830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009900 tx=0x7f9cb802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.054+0000 7f9cd038f640 1 -- 172.21.15.28:0/3133097894 shutdown_connections 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 --2- 172.21.15.28:0/3133097894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8108d70 0x7f9cc810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 --2- 172.21.15.28:0/3133097894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8108830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 --2- 172.21.15.28:0/3133097894 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8102ae0 0x7f9cc8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 -- 172.21.15.28:0/3133097894 >> 172.21.15.28:0/3133097894 conn(0x7f9cc8079770 msgr2=0x7f9cc8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 -- 172.21.15.28:0/3133097894 shutdown_connections 2024-09-21T07:05:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 -- 172.21.15.28:0/3133097894 wait complete. 2024-09-21T07:05:40.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 Processor -- start 2024-09-21T07:05:40.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.055+0000 7f9cd038f640 1 -- start start 2024-09-21T07:05:40.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8102ae0 0x7f9cc81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8108d70 0x7f9cc819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8112a30 con 0x7f9cc8108420 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81128b0 con 0x7f9cc8108d70 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cd038f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8112bb0 con 0x7f9cc8102ae0 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53404/0 (socket says 172.21.15.28:53404) 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 -- 172.21.15.28:0/571504447 learned_addr learned my addr 172.21.15.28:0/571504447 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cce12b640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8102ae0 0x7f9cc81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cce92c640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8108d70 0x7f9cc819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 -- 172.21.15.28:0/571504447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8102ae0 msgr2=0x7f9cc81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:40.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8102ae0 0x7f9cc81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 -- 172.21.15.28:0/571504447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8108d70 msgr2=0x7f9cc819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8108d70 0x7f9cc819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 -- 172.21.15.28:0/571504447 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc819f450 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9ccd92a640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9cb802a930 tx=0x7f9cb8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.056+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb803f030 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.057+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb8003aa0 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.057+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc819f6e0 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.057+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8035070 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.057+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc81a5ea0 con 0x7f9cc8108420 2024-09-21T07:05:40.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.058+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc8103d60 con 0x7f9cc8108420 2024-09-21T07:05:40.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.060+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9cb8042030 con 0x7f9cc8108420 2024-09-21T07:05:40.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.061+0000 7f9cbf7fe640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 0x7f9cb40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:40.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.061+0000 7f9cce12b640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 0x7f9cb40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:40.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.061+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9cb8107fd0 con 0x7f9cc8108420 2024-09-21T07:05:40.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.062+0000 7f9cce12b640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 0x7f9cb40b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4005fd0 tx=0x7f9cc4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:40.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.064+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cb80ce710 con 0x7f9cc8108420 2024-09-21T07:05:40.174 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:39 smithi028 ceph-mon[31213]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:05:40.174 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:39 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3766544748' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:05:40.174 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:39 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4199710349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:05:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.257+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f9cc8102ef0 con 0x7f9cc8108420 2024-09-21T07:05:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.257+0000 7f9cbf7fe640 1 -- 172.21.15.28:0/571504447 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9cb80d2af0 con 0x7f9cc8108420 2024-09-21T07:05:40.260 INFO:teuthology.orchestra.run.smithi028.stdout:257698037790 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 msgr2=0x7f9cb40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 0x7f9cb40b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4005fd0 tx=0x7f9cc4005850 comp rx=0 tx=0).stop 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 msgr2=0x7f9cc8199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9cb802a930 tx=0x7f9cb8004270 comp rx=0 tx=0).stop 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 shutdown_connections 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9cb40b65a0 0x7f9cb40b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9cc8108d70 0x7f9cc819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cc8108420 0x7f9cc8199a80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 --2- 172.21.15.28:0/571504447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc8102ae0 0x7f9cc81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:40.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 >> 172.21.15.28:0/571504447 conn(0x7f9cc8079770 msgr2=0x7f9cc8106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:40.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.259+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 shutdown_connections 2024-09-21T07:05:40.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:40.260+0000 7f9cd038f640 1 -- 172.21.15.28:0/571504447 wait complete. 2024-09-21T07:05:40.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:39 smithi181 ceph-mon[34686]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:05:40.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:39 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3766544748' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:05:40.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:39 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4199710349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:05:40.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:39 smithi129 ceph-mon[34863]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:05:40.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:39 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3766544748' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:05:40.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:39 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4199710349' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:05:40.562 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397541 got 210453397544 for osd.8 2024-09-21T07:05:40.562 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:41.265 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:40 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/571504447' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:05:41.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:40 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/571504447' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:05:41.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:40 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/571504447' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:05:41.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841559 got 283467841561 for osd.11 2024-09-21T07:05:41.753 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:42.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:41 smithi028 ceph-mon[31213]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T07:05:42.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037788 got 257698037790 for osd.10 2024-09-21T07:05:42.154 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:42.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:41 smithi181 ceph-mon[34686]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T07:05:42.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:41 smithi129 ceph-mon[34863]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T07:05:42.509 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:42.509 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:42.528 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:42.555 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:42.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920820 got 141733920823 for osd.5 2024-09-21T07:05:42.558 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:43.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/2315414519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88102a60 msgr2=0x7f8f88102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:43.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/2315414519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88102a60 0x7f8f88102e70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009900 tx=0x7f8f8402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/2315414519 shutdown_connections 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/2315414519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f88108cf0 0x7f8f8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/2315414519 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f881083a0 0x7f8f881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/2315414519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88102a60 0x7f8f88102e70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/2315414519 >> 172.21.15.28:0/2315414519 conn(0x7f8f88079730 msgr2=0x7f8f88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/2315414519 shutdown_connections 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.741+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/2315414519 wait complete. 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 Processor -- start 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 -- start start 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f88102a60 0x7f8f88199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f881083a0 0x7f8f881998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88112960 con 0x7f8f88108cf0 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881127e0 con 0x7f8f88102a60 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8f7bf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88112ae0 con 0x7f8f881083a0 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8dd5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8dd5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34782/0 (socket says 172.21.15.28:34782) 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8dd5c640 1 -- 172.21.15.28:0/1473436048 learned_addr learned my addr 172.21.15.28:0/1473436048 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.742+0000 7f8f8d55b640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f88102a60 0x7f8f88199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8cd5a640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f881083a0 0x7f8f881998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 -- 172.21.15.28:0/1473436048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f881083a0 msgr2=0x7f8f881998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f881083a0 0x7f8f881998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 -- 172.21.15.28:0/1473436048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f88102a60 msgr2=0x7f8f88199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f88102a60 0x7f8f88199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 -- 172.21.15.28:0/1473436048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8819f280 con 0x7f8f88108cf0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8dd5c640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000eaa0 tx=0x7f8f8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000cdb0 con 0x7f8f88108cf0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8819f570 con 0x7f8f88108cf0 2024-09-21T07:05:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f80005020 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f800116d0 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.743+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a5cd0 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.744+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88102e70 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.746+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8f800054a0 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.747+0000 7f8f7e7fc640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.747+0000 7f8f8d55b640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.747+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8f800e79f0 con 0x7f8f88108cf0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.747+0000 7f8f8d55b640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 0x7f8f740b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f84031440 tx=0x7f8f84009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.750+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f80016030 con 0x7f8f88108cf0 2024-09-21T07:05:43.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.943+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8f8819a440 con 0x7f8f88108cf0 2024-09-21T07:05:43.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.943+0000 7f8f7e7fc640 1 -- 172.21.15.28:0/1473436048 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f8819a440 con 0x7f8f88108cf0 2024-09-21T07:05:43.945 INFO:teuthology.orchestra.run.smithi028.stdout:98784247874 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 msgr2=0x7f8f740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 0x7f8f740b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f84031440 tx=0x7f8f84009560 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 msgr2=0x7f8f8819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000eaa0 tx=0x7f8f8000ef60 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 shutdown_connections 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f8f740b65a0 0x7f8f740b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f88108cf0 0x7f8f8819eb50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f881083a0 0x7f8f881998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 --2- 172.21.15.28:0/1473436048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8f88102a60 0x7f8f88199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.945+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 >> 172.21.15.28:0/1473436048 conn(0x7f8f88079730 msgr2=0x7f8f88101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.946+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 shutdown_connections 2024-09-21T07:05:43.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:43.946+0000 7f8f8f7bf640 1 -- 172.21.15.28:0/1473436048 wait complete. 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 -- 172.21.15.28:0/3797973606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c81083c0 msgr2=0x7fb9c81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 --2- 172.21.15.28:0/3797973606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c81083c0 0x7fb9c81087d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009900 tx=0x7fb9bc02a410 comp rx=0 tx=0).stop 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 -- 172.21.15.28:0/3797973606 shutdown_connections 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 --2- 172.21.15.28:0/3797973606 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 --2- 172.21.15.28:0/3797973606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c81083c0 0x7fb9c81087d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 --2- 172.21.15.28:0/3797973606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c8102a80 0x7fb9c8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 -- 172.21.15.28:0/3797973606 >> 172.21.15.28:0/3797973606 conn(0x7fb9c8079740 msgr2=0x7fb9c8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 -- 172.21.15.28:0/3797973606 shutdown_connections 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.011+0000 7fb9cd167640 1 -- 172.21.15.28:0/3797973606 wait complete. 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 Processor -- start 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 -- start start 2024-09-21T07:05:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c81083c0 0x7fb9c8199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8112980 con 0x7fb9c8102a80 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8112800 con 0x7fb9c8108d10 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.012+0000 7fb9cd167640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8112b00 con 0x7fb9c81083c0 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34806/0 (socket says 172.21.15.28:34806) 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 -- 172.21.15.28:0/2587759904 learned_addr learned my addr 172.21.15.28:0/2587759904 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c659c640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c81083c0 0x7fb9c8199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c759e640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 -- 172.21.15.28:0/2587759904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c81083c0 msgr2=0x7fb9c8199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c81083c0 0x7fb9c8199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 -- 172.21.15.28:0/2587759904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 msgr2=0x7fb9c819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 -- 172.21.15.28:0/2587759904 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c819f460 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c759e640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9c6d9d640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800d950 tx=0x7fb9b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8017070 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9b8009c30 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c819f750 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800f620 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.013+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c81a5eb0 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.015+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c8103d00 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.016+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb9b8005030 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.017+0000 7fb9affff640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 0x7fb9b00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.017+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb9b80e70e0 con 0x7fb9c8102a80 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.017+0000 7fb9c659c640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 0x7fb9b00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.018+0000 7fb9c659c640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 0x7fb9b00b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc000c00 tx=0x7fb9bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:44.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.020+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9b80ad7c0 con 0x7fb9c8102a80 2024-09-21T07:05:44.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.214+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb9c810ab00 con 0x7fb9c8102a80 2024-09-21T07:05:44.216 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:43 smithi028 ceph-mon[31213]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T07:05:44.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.214+0000 7fb9affff640 1 -- 172.21.15.28:0/2587759904 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9b8009de0 con 0x7fb9c8102a80 2024-09-21T07:05:44.217 INFO:teuthology.orchestra.run.smithi028.stdout:34359738450 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 msgr2=0x7fb9b00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 0x7fb9b00b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc000c00 tx=0x7fb9bc031400 comp rx=0 tx=0).stop 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 msgr2=0x7fb9c81994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800d950 tx=0x7fb9b800de10 comp rx=0 tx=0).stop 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 shutdown_connections 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb9b00b65a0 0x7fb9b00b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb9c8108d10 0x7fb9c819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9c81083c0 0x7fb9c8199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 --2- 172.21.15.28:0/2587759904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9c8102a80 0x7fb9c81994f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 >> 172.21.15.28:0/2587759904 conn(0x7fb9c8079740 msgr2=0x7fb9c8104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:44.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 shutdown_connections 2024-09-21T07:05:44.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.217+0000 7fb9cd167640 1 -- 172.21.15.28:0/2587759904 wait complete. 2024-09-21T07:05:44.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:43 smithi181 ceph-mon[34686]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T07:05:44.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:43 smithi129 ceph-mon[34863]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 -- 172.21.15.28:0/1926805357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c109df0 msgr2=0x7f745c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 --2- 172.21.15.28:0/1926805357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c109df0 0x7f745c110620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7454009ca0 tx=0x7f745402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 -- 172.21.15.28:0/1926805357 shutdown_connections 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 --2- 172.21.15.28:0/1926805357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c109df0 0x7f745c110620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 --2- 172.21.15.28:0/1926805357 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c1094a0 0x7f745c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 --2- 172.21.15.28:0/1926805357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c103b60 0x7f745c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 -- 172.21.15.28:0/1926805357 >> 172.21.15.28:0/1926805357 conn(0x7f745c07b850 msgr2=0x7f745c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 -- 172.21.15.28:0/1926805357 shutdown_connections 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.639+0000 7f7461eb9640 1 -- 172.21.15.28:0/1926805357 wait complete. 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 Processor -- start 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 -- start start 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c1094a0 0x7f745c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c109df0 0x7f745c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113ab0 con 0x7f745c103b60 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113930 con 0x7f745c109df0 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.640+0000 7f7461eb9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f745c113c30 con 0x7f745c1094a0 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34826/0 (socket says 172.21.15.28:34826) 2024-09-21T07:05:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 -- 172.21.15.28:0/48511979 learned_addr learned my addr 172.21.15.28:0/48511979 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745bfff640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c109df0 0x7f745c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f7452ffd640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c1094a0 0x7f745c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 -- 172.21.15.28:0/48511979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c1094a0 msgr2=0x7f745c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c1094a0 0x7f745c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 -- 172.21.15.28:0/48511979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c109df0 msgr2=0x7f745c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c109df0 0x7f745c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 -- 172.21.15.28:0/48511979 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c1a0390 con 0x7f745c103b60 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f745b7fe640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d770 tx=0x7f744c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c017070 con 0x7f745c103b60 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c1a0680 con 0x7f745c103b60 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f744c0054d0 con 0x7f745c103b60 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c004c30 con 0x7f745c103b60 2024-09-21T07:05:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.641+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c1a6de0 con 0x7f745c103b60 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.642+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c103f70 con 0x7f745c103b60 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.645+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f744c004dd0 con 0x7f745c103b60 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.646+0000 7f74597fa640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 0x7f74480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.646+0000 7f7452ffd640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 0x7f74480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.646+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f744c0e73a0 con 0x7f745c103b60 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.646+0000 7f7452ffd640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 0x7f74480b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7444005fd0 tx=0x7f7444005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.649+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f744c0ada80 con 0x7f745c103b60 2024-09-21T07:05:44.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.839+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f745c02e640 con 0x7f745c103b60 2024-09-21T07:05:44.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.839+0000 7f74597fa640 1 -- 172.21.15.28:0/48511979 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f744c0b1e60 con 0x7f745c103b60 2024-09-21T07:05:44.842 INFO:teuthology.orchestra.run.smithi028.stdout:167503724595 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 msgr2=0x7f74480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 0x7f74480b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7444005fd0 tx=0x7f7444005850 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 msgr2=0x7f745c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d770 tx=0x7f744c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 shutdown_connections 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f74480b65a0 0x7f74480b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f745c109df0 0x7f745c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c1094a0 0x7f745c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 --2- 172.21.15.28:0/48511979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745c103b60 0x7f745c19a420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:44.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 >> 172.21.15.28:0/48511979 conn(0x7f745c07b850 msgr2=0x7f745c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:44.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 shutdown_connections 2024-09-21T07:05:44.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:44.841+0000 7f7461eb9640 1 -- 172.21.15.28:0/48511979 wait complete. 2024-09-21T07:05:45.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:44 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1473436048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:05:45.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:44 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2587759904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:05:45.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:44 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/48511979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:05:45.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:44 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1473436048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:05:45.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:44 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2587759904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:05:45.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:44 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/48511979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:05:45.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 -- 172.21.15.28:0/3829981624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec108d20 msgr2=0x7fa9ec10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 --2- 172.21.15.28:0/3829981624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec108d20 0x7fa9ec10f550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009ca0 tx=0x7fa9e402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 -- 172.21.15.28:0/3829981624 shutdown_connections 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 --2- 172.21.15.28:0/3829981624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec108d20 0x7fa9ec10f550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 --2- 172.21.15.28:0/3829981624 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 --2- 172.21.15.28:0/3829981624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 0x7fa9ec102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 -- 172.21.15.28:0/3829981624 >> 172.21.15.28:0/3829981624 conn(0x7fa9ec079760 msgr2=0x7fa9ec079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 -- 172.21.15.28:0/3829981624 shutdown_connections 2024-09-21T07:05:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.277+0000 7fa9f320e640 1 -- 172.21.15.28:0/3829981624 wait complete. 2024-09-21T07:05:45.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 Processor -- start 2024-09-21T07:05:45.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 -- start start 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 0x7fa9ec105110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec108d20 0x7fa9ec105b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec1129f0 con 0x7fa9ec1083d0 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec112870 con 0x7fa9ec108d20 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f320e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec112b70 con 0x7fa9ec102ae0 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9ebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9ebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34854/0 (socket says 172.21.15.28:34854) 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9ebfff640 1 -- 172.21.15.28:0/1057347857 learned_addr learned my addr 172.21.15.28:0/1057347857 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f0faa640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 0x7fa9ec105110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.278+0000 7fa9f17ab640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec108d20 0x7fa9ec105b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 -- 172.21.15.28:0/1057347857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 msgr2=0x7fa9ec105110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 0x7fa9ec105110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 -- 172.21.15.28:0/1057347857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec108d20 msgr2=0x7fa9ec105b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec108d20 0x7fa9ec105b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 -- 172.21.15.28:0/1057347857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec1a8740 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9ebfff640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c970 tx=0x7fa9e000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0007bb0 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec1a8a30 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9e0007d50 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0004d80 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.279+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec1a8ff0 con 0x7fa9ec1083d0 2024-09-21T07:05:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.280+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec103d10 con 0x7fa9ec1083d0 2024-09-21T07:05:45.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.282+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa9e0004f60 con 0x7fa9ec1083d0 2024-09-21T07:05:45.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.283+0000 7fa9e9ffb640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 0x7fa9d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.283+0000 7fa9f0faa640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 0x7fa9d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.283+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9e00e7510 con 0x7fa9ec1083d0 2024-09-21T07:05:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.283+0000 7fa9f0faa640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 0x7fa9d40b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec106b60 tx=0x7fa9dc009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:45.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.286+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9e0014030 con 0x7fa9ec1083d0 2024-09-21T07:05:45.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:44 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1473436048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:05:45.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:44 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2587759904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:05:45.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:44 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/48511979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:05:45.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.476+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa9ec102ef0 con 0x7fa9ec1083d0 2024-09-21T07:05:45.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.477+0000 7fa9e9ffb640 1 -- 172.21.15.28:0/1057347857 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa9ec102ef0 con 0x7fa9ec1083d0 2024-09-21T07:05:45.479 INFO:teuthology.orchestra.run.smithi028.stdout:236223201316 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.479+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 msgr2=0x7fa9d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.479+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 0x7fa9d40b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec106b60 tx=0x7fa9dc009110 comp rx=0 tx=0).stop 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.479+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 msgr2=0x7fa9ec105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.479+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c970 tx=0x7fa9e000cd70 comp rx=0 tx=0).stop 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 shutdown_connections 2024-09-21T07:05:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fa9d40b65a0 0x7fa9d40b8ab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9ec108d20 0x7fa9ec105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec1083d0 0x7fa9ec105650 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 --2- 172.21.15.28:0/1057347857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9ec102ae0 0x7fa9ec105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 >> 172.21.15.28:0/1057347857 conn(0x7fa9ec079760 msgr2=0x7fa9ec06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 shutdown_connections 2024-09-21T07:05:45.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:45.480+0000 7fa9f320e640 1 -- 172.21.15.28:0/1057347857 wait complete. 2024-09-21T07:05:45.844 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247871 got 98784247874 for osd.3 2024-09-21T07:05:45.844 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:46.137 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:45 smithi028 ceph-mon[31213]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:46.137 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:45 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1057347857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:05:46.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:45 smithi181 ceph-mon[34686]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:46.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:45 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1057347857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:05:46.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:45 smithi129 ceph-mon[34863]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:46.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:45 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1057347857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:05:46.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738450 for osd.0 2024-09-21T07:05:46.476 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:47.207 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201312 got 236223201316 for osd.9 2024-09-21T07:05:47.208 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:47.672 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724592 got 167503724595 for osd.6 2024-09-21T07:05:47.672 DEBUG:teuthology.parallel:result is None 2024-09-21T07:05:47.672 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:05:47.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:05:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:48.232 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:47 smithi028 ceph-mon[31213]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:48.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:47 smithi181 ceph-mon[34686]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:48.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:47 smithi129 ceph-mon[34863]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:48.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 -- 172.21.15.28:0/3729420263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54601094b0 msgr2=0x7f54601098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:48.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 --2- 172.21.15.28:0/3729420263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54601094b0 0x7f54601098c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5450009900 tx=0x7f545002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:48.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 -- 172.21.15.28:0/3729420263 shutdown_connections 2024-09-21T07:05:48.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 --2- 172.21.15.28:0/3729420263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5460109e00 0x7f5460110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 --2- 172.21.15.28:0/3729420263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54601094b0 0x7f54601098c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 --2- 172.21.15.28:0/3729420263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 0x7f5460103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 -- 172.21.15.28:0/3729420263 >> 172.21.15.28:0/3729420263 conn(0x7f546007b910 msgr2=0x7f546007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 -- 172.21.15.28:0/3729420263 shutdown_connections 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.468+0000 7f5467340640 1 -- 172.21.15.28:0/3729420263 wait complete. 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.469+0000 7f5467340640 1 Processor -- start 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.469+0000 7f5467340640 1 -- start start 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 0x7f546019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54601094b0 0x7f546019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5460113ac0 con 0x7f5460109e00 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5460113940 con 0x7f5460103bc0 2024-09-21T07:05:48.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f5467340640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5460113c40 con 0x7f54601094b0 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34874/0 (socket says 172.21.15.28:34874) 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 -- 172.21.15.28:0/719654849 learned_addr learned my addr 172.21.15.28:0/719654849 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54650dc640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 0x7f546019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54648db640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54601094b0 0x7f546019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 -- 172.21.15.28:0/719654849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54601094b0 msgr2=0x7f546019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54601094b0 0x7f546019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 -- 172.21.15.28:0/719654849 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 msgr2=0x7f546019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 0x7f546019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.470+0000 7f54658dd640 1 -- 172.21.15.28:0/719654849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54601a03e0 con 0x7f5460109e00 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f54658dd640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f545800d750 tx=0x7f545800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458017070 con 0x7f5460109e00 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54580054d0 con 0x7f5460109e00 2024-09-21T07:05:48.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458004c60 con 0x7f5460109e00 2024-09-21T07:05:48.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54601a06d0 con 0x7f5460109e00 2024-09-21T07:05:48.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.471+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54601a6e30 con 0x7f5460109e00 2024-09-21T07:05:48.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.472+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5460104df0 con 0x7f5460109e00 2024-09-21T07:05:48.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.474+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5458009bd0 con 0x7f5460109e00 2024-09-21T07:05:48.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.475+0000 7f54567fc640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 0x7f544c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:48.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.475+0000 7f54650dc640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 0x7f544c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:48.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.475+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f54580e7120 con 0x7f5460109e00 2024-09-21T07:05:48.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.476+0000 7f54650dc640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 0x7f544c0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:48.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.478+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54580b1cc0 con 0x7f5460109e00 2024-09-21T07:05:48.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.671+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5460063800 con 0x7f544c0b6620 2024-09-21T07:05:48.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.679+0000 7f54567fc640 1 -- 172.21.15.28:0/719654849 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7f5460063800 con 0x7f544c0b6620 2024-09-21T07:05:48.684 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 msgr2=0x7f544c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 0x7f544c0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c009680 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 msgr2=0x7f546019fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f545800d750 tx=0x7f545800dc10 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 shutdown_connections 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f544c0b6620 0x7f544c0b8b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5460109e00 0x7f546019fcb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54601094b0 0x7f546019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 --2- 172.21.15.28:0/719654849 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5460103bc0 0x7f546019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 >> 172.21.15.28:0/719654849 conn(0x7f546007b910 msgr2=0x7f5460107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 shutdown_connections 2024-09-21T07:05:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:48.684+0000 7f5467340640 1 -- 172.21.15.28:0/719654849 wait complete. 2024-09-21T07:05:49.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:49.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:49.499 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:49.499 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:49.499 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.527 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T07:05:48.277956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659549,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":427,"num_read_kb":312,"num_write":283,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371724,"kb_used_data":9936,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570100,"statfs":{"total":1151940427776,"available":1151559782400,"internally_reserved":0,"allocated":10174464,"data_stored":6695943,"data_compressed":114642,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847313+0000","last_change":"2024-09-21T07:04:40.072039+0000","last_active":"2024-09-21T07:05:13.847313+0000","last_peered":"2024-09-21T07:05:13.847313+0000","last_clean":"2024-09-21T07:05:13.847313+0000","last_became_active":"2024-09-21T07:04:40.071228+0000","last_became_peered":"2024-09-21T07:04:40.071228+0000","last_unstale":"2024-09-21T07:05:13.847313+0000","last_undegraded":"2024-09-21T07:05:13.847313+0000","last_fullsized":"2024-09-21T07:05:13.847313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:42.645145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845099+0000","last_change":"2024-09-21T07:04:40.062714+0000","last_active":"2024-09-21T07:05:13.845099+0000","last_peered":"2024-09-21T07:05:13.845099+0000","last_clean":"2024-09-21T07:05:13.845099+0000","last_became_active":"2024-09-21T07:04:40.062309+0000","last_became_peered":"2024-09-21T07:04:40.062309+0000","last_unstale":"2024-09-21T07:05:13.845099+0000","last_undegraded":"2024-09-21T07:05:13.845099+0000","last_fullsized":"2024-09-21T07:05:13.845099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.604991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845098+0000","last_change":"2024-09-21T07:04:40.071023+0000","last_active":"2024-09-21T07:05:13.845098+0000","last_peered":"2024-09-21T07:05:13.845098+0000","last_clean":"2024-09-21T07:05:13.845098+0000","last_became_active":"2024-09-21T07:04:40.069846+0000","last_became_peered":"2024-09-21T07:04:40.069846+0000","last_unstale":"2024-09-21T07:05:13.845098+0000","last_undegraded":"2024-09-21T07:05:13.845098+0000","last_fullsized":"2024-09-21T07:05:13.845098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:45.611132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.956993+0000","last_change":"2024-09-21T07:04:40.058144+0000","last_active":"2024-09-21T07:05:13.956993+0000","last_peered":"2024-09-21T07:05:13.956993+0000","last_clean":"2024-09-21T07:05:13.956993+0000","last_became_active":"2024-09-21T07:04:40.057753+0000","last_became_peered":"2024-09-21T07:04:40.057753+0000","last_unstale":"2024-09-21T07:05:13.956993+0000","last_undegraded":"2024-09-21T07:05:13.956993+0000","last_fullsized":"2024-09-21T07:05:13.956993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:37.578024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.851770+0000","last_change":"2024-09-21T07:05:13.851650+0000","last_active":"2024-09-21T07:05:13.851770+0000","last_peered":"2024-09-21T07:05:13.851770+0000","last_clean":"2024-09-21T07:05:13.851770+0000","last_became_active":"2024-09-21T07:05:13.851033+0000","last_became_peered":"2024-09-21T07:05:13.851033+0000","last_unstale":"2024-09-21T07:05:13.851770+0000","last_undegraded":"2024-09-21T07:05:13.851770+0000","last_fullsized":"2024-09-21T07:05:13.851770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:14.837851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903218+0000","last_change":"2024-09-21T07:04:40.076852+0000","last_active":"2024-09-21T07:05:13.903218+0000","last_peered":"2024-09-21T07:05:13.903218+0000","last_clean":"2024-09-21T07:05:13.903218+0000","last_became_active":"2024-09-21T07:04:40.076377+0000","last_became_peered":"2024-09-21T07:04:40.076377+0000","last_unstale":"2024-09-21T07:05:13.903218+0000","last_undegraded":"2024-09-21T07:05:13.903218+0000","last_fullsized":"2024-09-21T07:05:13.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:21.776048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847832+0000","last_change":"2024-09-21T07:04:40.075024+0000","last_active":"2024-09-21T07:05:13.847832+0000","last_peered":"2024-09-21T07:05:13.847832+0000","last_clean":"2024-09-21T07:05:13.847832+0000","last_became_active":"2024-09-21T07:04:40.074651+0000","last_became_peered":"2024-09-21T07:04:40.074651+0000","last_unstale":"2024-09-21T07:05:13.847832+0000","last_undegraded":"2024-09-21T07:05:13.847832+0000","last_fullsized":"2024-09-21T07:05:13.847832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:04.184336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848592+0000","last_change":"2024-09-21T07:04:40.067007+0000","last_active":"2024-09-21T07:05:13.848592+0000","last_peered":"2024-09-21T07:05:13.848592+0000","last_clean":"2024-09-21T07:05:13.848592+0000","last_became_active":"2024-09-21T07:04:40.065599+0000","last_became_peered":"2024-09-21T07:04:40.065599+0000","last_unstale":"2024-09-21T07:05:13.848592+0000","last_undegraded":"2024-09-21T07:05:13.848592+0000","last_fullsized":"2024-09-21T07:05:13.848592+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:45.868671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102279+0000","last_change":"2024-09-21T07:04:40.079713+0000","last_active":"2024-09-21T07:05:14.102279+0000","last_peered":"2024-09-21T07:05:14.102279+0000","last_clean":"2024-09-21T07:05:14.102279+0000","last_became_active":"2024-09-21T07:04:40.078983+0000","last_became_peered":"2024-09-21T07:04:40.078983+0000","last_unstale":"2024-09-21T07:05:14.102279+0000","last_undegraded":"2024-09-21T07:05:14.102279+0000","last_fullsized":"2024-09-21T07:05:14.102279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:32.077942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903625+0000","last_change":"2024-09-21T07:04:40.078249+0000","last_active":"2024-09-21T07:05:13.903625+0000","last_peered":"2024-09-21T07:05:13.903625+0000","last_clean":"2024-09-21T07:05:13.903625+0000","last_became_active":"2024-09-21T07:04:40.077882+0000","last_became_peered":"2024-09-21T07:04:40.077882+0000","last_unstale":"2024-09-21T07:05:13.903625+0000","last_undegraded":"2024-09-21T07:05:13.903625+0000","last_fullsized":"2024-09-21T07:05:13.903625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:32.360168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848302+0000","last_change":"2024-09-21T07:04:40.070979+0000","last_active":"2024-09-21T07:05:13.848302+0000","last_peered":"2024-09-21T07:05:13.848302+0000","last_clean":"2024-09-21T07:05:13.848302+0000","last_became_active":"2024-09-21T07:04:40.070592+0000","last_became_peered":"2024-09-21T07:04:40.070592+0000","last_unstale":"2024-09-21T07:05:13.848302+0000","last_undegraded":"2024-09-21T07:05:13.848302+0000","last_fullsized":"2024-09-21T07:05:13.848302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:36.224263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957034+0000","last_change":"2024-09-21T07:04:40.069650+0000","last_active":"2024-09-21T07:05:13.957034+0000","last_peered":"2024-09-21T07:05:13.957034+0000","last_clean":"2024-09-21T07:05:13.957034+0000","last_became_active":"2024-09-21T07:04:40.068885+0000","last_became_peered":"2024-09-21T07:04:40.068885+0000","last_unstale":"2024-09-21T07:05:13.957034+0000","last_undegraded":"2024-09-21T07:05:13.957034+0000","last_fullsized":"2024-09-21T07:05:13.957034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.187038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843811+0000","last_change":"2024-09-21T07:04:40.061852+0000","last_active":"2024-09-21T07:05:13.843811+0000","last_peered":"2024-09-21T07:05:13.843811+0000","last_clean":"2024-09-21T07:05:13.843811+0000","last_became_active":"2024-09-21T07:04:40.061490+0000","last_became_peered":"2024-09-21T07:04:40.061490+0000","last_unstale":"2024-09-21T07:05:13.843811+0000","last_undegraded":"2024-09-21T07:05:13.843811+0000","last_fullsized":"2024-09-21T07:05:13.843811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:43.570941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.844934+0000","last_change":"2024-09-21T07:04:40.066844+0000","last_active":"2024-09-21T07:05:13.844934+0000","last_peered":"2024-09-21T07:05:13.844934+0000","last_clean":"2024-09-21T07:05:13.844934+0000","last_became_active":"2024-09-21T07:04:40.066472+0000","last_became_peered":"2024-09-21T07:04:40.066472+0000","last_unstale":"2024-09-21T07:05:13.844934+0000","last_undegraded":"2024-09-21T07:05:13.844934+0000","last_fullsized":"2024-09-21T07:05:13.844934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:58.798270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.844913+0000","last_change":"2024-09-21T07:04:40.068856+0000","last_active":"2024-09-21T07:05:13.844913+0000","last_peered":"2024-09-21T07:05:13.844913+0000","last_clean":"2024-09-21T07:05:13.844913+0000","last_became_active":"2024-09-21T07:04:40.068483+0000","last_became_peered":"2024-09-21T07:04:40.068483+0000","last_unstale":"2024-09-21T07:05:13.844913+0000","last_undegraded":"2024-09-21T07:05:13.844913+0000","last_fullsized":"2024-09-21T07:05:13.844913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101660+0000","last_change":"2024-09-21T07:04:40.072565+0000","last_active":"2024-09-21T07:05:14.101660+0000","last_peered":"2024-09-21T07:05:14.101660+0000","last_clean":"2024-09-21T07:05:14.101660+0000","last_became_active":"2024-09-21T07:04:40.071464+0000","last_became_peered":"2024-09-21T07:04:40.071464+0000","last_unstale":"2024-09-21T07:05:14.101660+0000","last_undegraded":"2024-09-21T07:05:14.101660+0000","last_fullsized":"2024-09-21T07:05:14.101660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.821627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847462+0000","last_change":"2024-09-21T07:04:40.071563+0000","last_active":"2024-09-21T07:05:13.847462+0000","last_peered":"2024-09-21T07:05:13.847462+0000","last_clean":"2024-09-21T07:05:13.847462+0000","last_became_active":"2024-09-21T07:04:40.070763+0000","last_became_peered":"2024-09-21T07:04:40.070763+0000","last_unstale":"2024-09-21T07:05:13.847462+0000","last_undegraded":"2024-09-21T07:05:13.847462+0000","last_fullsized":"2024-09-21T07:05:13.847462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:01.856385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847845+0000","last_change":"2024-09-21T07:04:40.071528+0000","last_active":"2024-09-21T07:05:13.847845+0000","last_peered":"2024-09-21T07:05:13.847845+0000","last_clean":"2024-09-21T07:05:13.847845+0000","last_became_active":"2024-09-21T07:04:40.071146+0000","last_became_peered":"2024-09-21T07:04:40.071146+0000","last_unstale":"2024-09-21T07:05:13.847845+0000","last_undegraded":"2024-09-21T07:05:13.847845+0000","last_fullsized":"2024-09-21T07:05:13.847845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:30.032226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849818+0000","last_change":"2024-09-21T07:04:40.066043+0000","last_active":"2024-09-21T07:05:13.849818+0000","last_peered":"2024-09-21T07:05:13.849818+0000","last_clean":"2024-09-21T07:05:13.849818+0000","last_became_active":"2024-09-21T07:04:40.065651+0000","last_became_peered":"2024-09-21T07:04:40.065651+0000","last_unstale":"2024-09-21T07:05:13.849818+0000","last_undegraded":"2024-09-21T07:05:13.849818+0000","last_fullsized":"2024-09-21T07:05:13.849818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:26.450331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847015+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:05:13.847015+0000","last_peered":"2024-09-21T07:05:13.847015+0000","last_clean":"2024-09-21T07:05:13.847015+0000","last_became_active":"2024-09-21T07:04:40.076129+0000","last_became_peered":"2024-09-21T07:04:40.076129+0000","last_unstale":"2024-09-21T07:05:13.847015+0000","last_undegraded":"2024-09-21T07:05:13.847015+0000","last_fullsized":"2024-09-21T07:05:13.847015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:14.019420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843824+0000","last_change":"2024-09-21T07:04:40.072299+0000","last_active":"2024-09-21T07:05:13.843824+0000","last_peered":"2024-09-21T07:05:13.843824+0000","last_clean":"2024-09-21T07:05:13.843824+0000","last_became_active":"2024-09-21T07:04:40.071883+0000","last_became_peered":"2024-09-21T07:04:40.071883+0000","last_unstale":"2024-09-21T07:05:13.843824+0000","last_undegraded":"2024-09-21T07:05:13.843824+0000","last_fullsized":"2024-09-21T07:05:13.843824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:20.065717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101782+0000","last_change":"2024-09-21T07:04:40.072016+0000","last_active":"2024-09-21T07:05:14.101782+0000","last_peered":"2024-09-21T07:05:14.101782+0000","last_clean":"2024-09-21T07:05:14.101782+0000","last_became_active":"2024-09-21T07:04:40.071543+0000","last_became_peered":"2024-09-21T07:04:40.071543+0000","last_unstale":"2024-09-21T07:05:14.101782+0000","last_undegraded":"2024-09-21T07:05:14.101782+0000","last_fullsized":"2024-09-21T07:05:14.101782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:28.427766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849139+0000","last_change":"2024-09-21T07:04:40.075354+0000","last_active":"2024-09-21T07:05:13.849139+0000","last_peered":"2024-09-21T07:05:13.849139+0000","last_clean":"2024-09-21T07:05:13.849139+0000","last_became_active":"2024-09-21T07:04:40.075037+0000","last_became_peered":"2024-09-21T07:04:40.075037+0000","last_unstale":"2024-09-21T07:05:13.849139+0000","last_undegraded":"2024-09-21T07:05:13.849139+0000","last_fullsized":"2024-09-21T07:05:13.849139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.473774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101507+0000","last_change":"2024-09-21T07:04:40.066252+0000","last_active":"2024-09-21T07:05:14.101507+0000","last_peered":"2024-09-21T07:05:14.101507+0000","last_clean":"2024-09-21T07:05:14.101507+0000","last_became_active":"2024-09-21T07:04:40.065907+0000","last_became_peered":"2024-09-21T07:04:40.065907+0000","last_unstale":"2024-09-21T07:05:14.101507+0000","last_undegraded":"2024-09-21T07:05:14.101507+0000","last_fullsized":"2024-09-21T07:05:14.101507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:21.807697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.853504+0000","last_change":"2024-09-21T07:05:13.853396+0000","last_active":"2024-09-21T07:05:13.853504+0000","last_peered":"2024-09-21T07:05:13.853504+0000","last_clean":"2024-09-21T07:05:13.853504+0000","last_became_active":"2024-09-21T07:05:13.852971+0000","last_became_peered":"2024-09-21T07:05:13.852971+0000","last_unstale":"2024-09-21T07:05:13.853504+0000","last_undegraded":"2024-09-21T07:05:13.853504+0000","last_fullsized":"2024-09-21T07:05:13.853504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849813+0000","last_change":"2024-09-21T07:04:40.069865+0000","last_active":"2024-09-21T07:05:13.849813+0000","last_peered":"2024-09-21T07:05:13.849813+0000","last_clean":"2024-09-21T07:05:13.849813+0000","last_became_active":"2024-09-21T07:04:40.069456+0000","last_became_peered":"2024-09-21T07:04:40.069456+0000","last_unstale":"2024-09-21T07:05:13.849813+0000","last_undegraded":"2024-09-21T07:05:13.849813+0000","last_fullsized":"2024-09-21T07:05:13.849813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847838+0000","last_change":"2024-09-21T07:04:40.065527+0000","last_active":"2024-09-21T07:05:13.847838+0000","last_peered":"2024-09-21T07:05:13.847838+0000","last_clean":"2024-09-21T07:05:13.847838+0000","last_became_active":"2024-09-21T07:04:40.065187+0000","last_became_peered":"2024-09-21T07:04:40.065187+0000","last_unstale":"2024-09-21T07:05:13.847838+0000","last_undegraded":"2024-09-21T07:05:13.847838+0000","last_fullsized":"2024-09-21T07:05:13.847838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.615948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843646+0000","last_change":"2024-09-21T07:04:40.074025+0000","last_active":"2024-09-21T07:05:13.843646+0000","last_peered":"2024-09-21T07:05:13.843646+0000","last_clean":"2024-09-21T07:05:13.843646+0000","last_became_active":"2024-09-21T07:04:40.073669+0000","last_became_peered":"2024-09-21T07:04:40.073669+0000","last_unstale":"2024-09-21T07:05:13.843646+0000","last_undegraded":"2024-09-21T07:05:13.843646+0000","last_fullsized":"2024-09-21T07:05:13.843646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:22.863209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.850201+0000","last_change":"2024-09-21T07:05:13.850092+0000","last_active":"2024-09-21T07:05:13.850201+0000","last_peered":"2024-09-21T07:05:13.850201+0000","last_clean":"2024-09-21T07:05:13.850201+0000","last_became_active":"2024-09-21T07:05:13.849593+0000","last_became_peered":"2024-09-21T07:05:13.849593+0000","last_unstale":"2024-09-21T07:05:13.850201+0000","last_undegraded":"2024-09-21T07:05:13.850201+0000","last_fullsized":"2024-09-21T07:05:13.850201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:14.694956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849316+0000","last_change":"2024-09-21T07:04:40.065818+0000","last_active":"2024-09-21T07:05:13.849316+0000","last_peered":"2024-09-21T07:05:13.849316+0000","last_clean":"2024-09-21T07:05:13.849316+0000","last_became_active":"2024-09-21T07:04:40.065422+0000","last_became_peered":"2024-09-21T07:04:40.065422+0000","last_unstale":"2024-09-21T07:05:13.849316+0000","last_undegraded":"2024-09-21T07:05:13.849316+0000","last_fullsized":"2024-09-21T07:05:13.849316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:28.597574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849519+0000","last_change":"2024-09-21T07:04:40.064223+0000","last_active":"2024-09-21T07:05:13.849519+0000","last_peered":"2024-09-21T07:05:13.849519+0000","last_clean":"2024-09-21T07:05:13.849519+0000","last_became_active":"2024-09-21T07:04:40.057620+0000","last_became_peered":"2024-09-21T07:04:40.057620+0000","last_unstale":"2024-09-21T07:05:13.849519+0000","last_undegraded":"2024-09-21T07:05:13.849519+0000","last_fullsized":"2024-09-21T07:05:13.849519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:25.518187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846714+0000","last_change":"2024-09-21T07:04:40.070105+0000","last_active":"2024-09-21T07:05:13.846714+0000","last_peered":"2024-09-21T07:05:13.846714+0000","last_clean":"2024-09-21T07:05:13.846714+0000","last_became_active":"2024-09-21T07:04:40.068920+0000","last_became_peered":"2024-09-21T07:04:40.068920+0000","last_unstale":"2024-09-21T07:05:13.846714+0000","last_undegraded":"2024-09-21T07:05:13.846714+0000","last_fullsized":"2024-09-21T07:05:13.846714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:51.847607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845667+0000","last_change":"2024-09-21T07:04:40.064852+0000","last_active":"2024-09-21T07:05:13.845667+0000","last_peered":"2024-09-21T07:05:13.845667+0000","last_clean":"2024-09-21T07:05:13.845667+0000","last_became_active":"2024-09-21T07:04:40.064476+0000","last_became_peered":"2024-09-21T07:04:40.064476+0000","last_unstale":"2024-09-21T07:05:13.845667+0000","last_undegraded":"2024-09-21T07:05:13.845667+0000","last_fullsized":"2024-09-21T07:05:13.845667+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:45.579783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:42.439926+0000","last_change":"2024-09-21T07:04:38.052529+0000","last_active":"2024-09-21T07:05:42.439926+0000","last_peered":"2024-09-21T07:05:42.439926+0000","last_clean":"2024-09-21T07:05:42.439926+0000","last_became_active":"2024-09-21T07:04:38.052117+0000","last_became_peered":"2024-09-21T07:04:38.052117+0000","last_unstale":"2024-09-21T07:05:42.439926+0000","last_undegraded":"2024-09-21T07:05:42.439926+0000","last_fullsized":"2024-09-21T07:05:42.439926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:06.454006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101720+0000","last_change":"2024-09-21T07:04:40.077259+0000","last_active":"2024-09-21T07:05:14.101720+0000","last_peered":"2024-09-21T07:05:14.101720+0000","last_clean":"2024-09-21T07:05:14.101720+0000","last_became_active":"2024-09-21T07:04:40.076911+0000","last_became_peered":"2024-09-21T07:04:40.076911+0000","last_unstale":"2024-09-21T07:05:14.101720+0000","last_undegraded":"2024-09-21T07:05:14.101720+0000","last_fullsized":"2024-09-21T07:05:14.101720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:08.410875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903272+0000","last_change":"2024-09-21T07:04:38.052545+0000","last_active":"2024-09-21T07:05:13.903272+0000","last_peered":"2024-09-21T07:05:13.903272+0000","last_clean":"2024-09-21T07:05:13.903272+0000","last_became_active":"2024-09-21T07:04:38.052115+0000","last_became_peered":"2024-09-21T07:04:38.052115+0000","last_unstale":"2024-09-21T07:05:13.903272+0000","last_undegraded":"2024-09-21T07:05:13.903272+0000","last_fullsized":"2024-09-21T07:05:13.903272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.021727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843388+0000","last_change":"2024-09-21T07:04:38.050595+0000","last_active":"2024-09-21T07:05:13.843388+0000","last_peered":"2024-09-21T07:05:13.843388+0000","last_clean":"2024-09-21T07:05:13.843388+0000","last_became_active":"2024-09-21T07:04:38.050206+0000","last_became_peered":"2024-09-21T07:04:38.050206+0000","last_unstale":"2024-09-21T07:05:13.843388+0000","last_undegraded":"2024-09-21T07:05:13.843388+0000","last_fullsized":"2024-09-21T07:05:13.843388+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:37.746521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848693+0000","last_change":"2024-09-21T07:04:40.075300+0000","last_active":"2024-09-21T07:05:13.848693+0000","last_peered":"2024-09-21T07:05:13.848693+0000","last_clean":"2024-09-21T07:05:13.848693+0000","last_became_active":"2024-09-21T07:04:40.074959+0000","last_became_peered":"2024-09-21T07:04:40.074959+0000","last_unstale":"2024-09-21T07:05:13.848693+0000","last_undegraded":"2024-09-21T07:05:13.848693+0000","last_fullsized":"2024-09-21T07:05:13.848693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:42.935716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101819+0000","last_change":"2024-09-21T07:04:38.056440+0000","last_active":"2024-09-21T07:05:14.101819+0000","last_peered":"2024-09-21T07:05:14.101819+0000","last_clean":"2024-09-21T07:05:14.101819+0000","last_became_active":"2024-09-21T07:04:38.055917+0000","last_became_peered":"2024-09-21T07:04:38.055917+0000","last_unstale":"2024-09-21T07:05:14.101819+0000","last_undegraded":"2024-09-21T07:05:14.101819+0000","last_fullsized":"2024-09-21T07:05:14.101819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:54.090537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847593+0000","last_change":"2024-09-21T07:04:40.061602+0000","last_active":"2024-09-21T07:05:13.847593+0000","last_peered":"2024-09-21T07:05:13.847593+0000","last_clean":"2024-09-21T07:05:13.847593+0000","last_became_active":"2024-09-21T07:04:40.061209+0000","last_became_peered":"2024-09-21T07:04:40.061209+0000","last_unstale":"2024-09-21T07:05:13.847593+0000","last_undegraded":"2024-09-21T07:05:13.847593+0000","last_fullsized":"2024-09-21T07:05:13.847593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:31.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'3","reported_seq":80,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:42.439351+0000","last_change":"2024-09-21T07:04:38.053231+0000","last_active":"2024-09-21T07:05:42.439351+0000","last_peered":"2024-09-21T07:05:42.439351+0000","last_clean":"2024-09-21T07:05:42.439351+0000","last_became_active":"2024-09-21T07:04:38.052824+0000","last_became_peered":"2024-09-21T07:04:38.052824+0000","last_unstale":"2024-09-21T07:05:42.439351+0000","last_undegraded":"2024-09-21T07:05:42.439351+0000","last_fullsized":"2024-09-21T07:05:42.439351+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:44.168096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102139+0000","last_change":"2024-09-21T07:04:40.070107+0000","last_active":"2024-09-21T07:05:14.102139+0000","last_peered":"2024-09-21T07:05:14.102139+0000","last_clean":"2024-09-21T07:05:14.102139+0000","last_became_active":"2024-09-21T07:04:40.069649+0000","last_became_peered":"2024-09-21T07:04:40.069649+0000","last_unstale":"2024-09-21T07:05:14.102139+0000","last_undegraded":"2024-09-21T07:05:14.102139+0000","last_fullsized":"2024-09-21T07:05:14.102139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.824442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848014+0000","last_change":"2024-09-21T07:04:38.049413+0000","last_active":"2024-09-21T07:05:13.848014+0000","last_peered":"2024-09-21T07:05:13.848014+0000","last_clean":"2024-09-21T07:05:13.848014+0000","last_became_active":"2024-09-21T07:04:38.049034+0000","last_became_peered":"2024-09-21T07:04:38.049034+0000","last_unstale":"2024-09-21T07:05:13.848014+0000","last_undegraded":"2024-09-21T07:05:13.848014+0000","last_fullsized":"2024-09-21T07:05:13.848014+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.866543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845455+0000","last_change":"2024-09-21T07:04:40.075411+0000","last_active":"2024-09-21T07:05:13.845455+0000","last_peered":"2024-09-21T07:05:13.845455+0000","last_clean":"2024-09-21T07:05:13.845455+0000","last_became_active":"2024-09-21T07:04:40.074410+0000","last_became_peered":"2024-09-21T07:04:40.074410+0000","last_unstale":"2024-09-21T07:05:13.845455+0000","last_undegraded":"2024-09-21T07:05:13.845455+0000","last_fullsized":"2024-09-21T07:05:13.845455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:15.685477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101877+0000","last_change":"2024-09-21T07:04:38.138349+0000","last_active":"2024-09-21T07:05:14.101877+0000","last_peered":"2024-09-21T07:05:14.101877+0000","last_clean":"2024-09-21T07:05:14.101877+0000","last_became_active":"2024-09-21T07:04:38.137934+0000","last_became_peered":"2024-09-21T07:04:38.137934+0000","last_unstale":"2024-09-21T07:05:14.101877+0000","last_undegraded":"2024-09-21T07:05:14.101877+0000","last_fullsized":"2024-09-21T07:05:14.101877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.963760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101853+0000","last_change":"2024-09-21T07:04:40.076072+0000","last_active":"2024-09-21T07:05:14.101853+0000","last_peered":"2024-09-21T07:05:14.101853+0000","last_clean":"2024-09-21T07:05:14.101853+0000","last_became_active":"2024-09-21T07:04:40.075637+0000","last_became_peered":"2024-09-21T07:04:40.075637+0000","last_unstale":"2024-09-21T07:05:14.101853+0000","last_undegraded":"2024-09-21T07:05:14.101853+0000","last_fullsized":"2024-09-21T07:05:14.101853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:52.272797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'27","reported_seq":165,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:43.440377+0000","last_change":"2024-09-21T07:04:38.052777+0000","last_active":"2024-09-21T07:05:43.440377+0000","last_peered":"2024-09-21T07:05:43.440377+0000","last_clean":"2024-09-21T07:05:43.440377+0000","last_became_active":"2024-09-21T07:04:38.052319+0000","last_became_peered":"2024-09-21T07:04:38.052319+0000","last_unstale":"2024-09-21T07:05:43.440377+0000","last_undegraded":"2024-09-21T07:05:43.440377+0000","last_fullsized":"2024-09-21T07:05:43.440377+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:26.124318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65337,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":120,"num_write":28,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845964+0000","last_change":"2024-09-21T07:04:40.073693+0000","last_active":"2024-09-21T07:05:13.845964+0000","last_peered":"2024-09-21T07:05:13.845964+0000","last_clean":"2024-09-21T07:05:13.845964+0000","last_became_active":"2024-09-21T07:04:40.073362+0000","last_became_peered":"2024-09-21T07:04:40.073362+0000","last_unstale":"2024-09-21T07:05:13.845964+0000","last_undegraded":"2024-09-21T07:05:13.845964+0000","last_fullsized":"2024-09-21T07:05:13.845964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:47.193733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'6","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849782+0000","last_change":"2024-09-21T07:04:38.052881+0000","last_active":"2024-09-21T07:05:13.849782+0000","last_peered":"2024-09-21T07:05:13.849782+0000","last_clean":"2024-09-21T07:05:13.849782+0000","last_became_active":"2024-09-21T07:04:38.052499+0000","last_became_peered":"2024-09-21T07:04:38.052499+0000","last_unstale":"2024-09-21T07:05:13.849782+0000","last_undegraded":"2024-09-21T07:05:13.849782+0000","last_fullsized":"2024-09-21T07:05:13.849782+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.871624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843445+0000","last_change":"2024-09-21T07:04:40.070165+0000","last_active":"2024-09-21T07:05:13.843445+0000","last_peered":"2024-09-21T07:05:13.843445+0000","last_clean":"2024-09-21T07:05:13.843445+0000","last_became_active":"2024-09-21T07:04:40.068422+0000","last_became_peered":"2024-09-21T07:04:40.068422+0000","last_unstale":"2024-09-21T07:05:13.843445+0000","last_undegraded":"2024-09-21T07:05:13.843445+0000","last_fullsized":"2024-09-21T07:05:13.843445+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:09.593392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101770+0000","last_change":"2024-09-21T07:04:38.053713+0000","last_active":"2024-09-21T07:05:14.101770+0000","last_peered":"2024-09-21T07:05:14.101770+0000","last_clean":"2024-09-21T07:05:14.101770+0000","last_became_active":"2024-09-21T07:04:38.053283+0000","last_became_peered":"2024-09-21T07:04:38.053283+0000","last_unstale":"2024-09-21T07:05:14.101770+0000","last_undegraded":"2024-09-21T07:05:14.101770+0000","last_fullsized":"2024-09-21T07:05:14.101770+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:53.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848550+0000","last_change":"2024-09-21T07:04:40.080396+0000","last_active":"2024-09-21T07:05:13.848550+0000","last_peered":"2024-09-21T07:05:13.848550+0000","last_clean":"2024-09-21T07:05:13.848550+0000","last_became_active":"2024-09-21T07:04:40.080040+0000","last_became_peered":"2024-09-21T07:04:40.080040+0000","last_unstale":"2024-09-21T07:05:13.848550+0000","last_undegraded":"2024-09-21T07:05:13.848550+0000","last_fullsized":"2024-09-21T07:05:13.848550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:26.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'3","reported_seq":82,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:42.440054+0000","last_change":"2024-09-21T07:04:38.051776+0000","last_active":"2024-09-21T07:05:42.440054+0000","last_peered":"2024-09-21T07:05:42.440054+0000","last_clean":"2024-09-21T07:05:42.440054+0000","last_became_active":"2024-09-21T07:04:38.048551+0000","last_became_peered":"2024-09-21T07:04:38.048551+0000","last_unstale":"2024-09-21T07:05:42.440054+0000","last_undegraded":"2024-09-21T07:05:42.440054+0000","last_fullsized":"2024-09-21T07:05:42.440054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.640949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847741+0000","last_change":"2024-09-21T07:04:40.066595+0000","last_active":"2024-09-21T07:05:13.847741+0000","last_peered":"2024-09-21T07:05:13.847741+0000","last_clean":"2024-09-21T07:05:13.847741+0000","last_became_active":"2024-09-21T07:04:40.063872+0000","last_became_peered":"2024-09-21T07:04:40.063872+0000","last_unstale":"2024-09-21T07:05:13.847741+0000","last_undegraded":"2024-09-21T07:05:13.847741+0000","last_fullsized":"2024-09-21T07:05:13.847741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:37.820834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'15","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845504+0000","last_change":"2024-09-21T07:04:38.138472+0000","last_active":"2024-09-21T07:05:13.845504+0000","last_peered":"2024-09-21T07:05:13.845504+0000","last_clean":"2024-09-21T07:05:13.845504+0000","last_became_active":"2024-09-21T07:04:38.138095+0000","last_became_peered":"2024-09-21T07:04:38.138095+0000","last_unstale":"2024-09-21T07:05:13.845504+0000","last_undegraded":"2024-09-21T07:05:13.845504+0000","last_fullsized":"2024-09-21T07:05:13.845504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:50.789021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101603+0000","last_change":"2024-09-21T07:04:40.076508+0000","last_active":"2024-09-21T07:05:14.101603+0000","last_peered":"2024-09-21T07:05:14.101603+0000","last_clean":"2024-09-21T07:05:14.101603+0000","last_became_active":"2024-09-21T07:04:40.076115+0000","last_became_peered":"2024-09-21T07:04:40.076115+0000","last_unstale":"2024-09-21T07:05:14.101603+0000","last_undegraded":"2024-09-21T07:05:14.101603+0000","last_fullsized":"2024-09-21T07:05:14.101603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:19.803762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845960+0000","last_change":"2024-09-21T07:04:38.056502+0000","last_active":"2024-09-21T07:05:13.845960+0000","last_peered":"2024-09-21T07:05:13.845960+0000","last_clean":"2024-09-21T07:05:13.845960+0000","last_became_active":"2024-09-21T07:04:38.056146+0000","last_became_peered":"2024-09-21T07:04:38.056146+0000","last_unstale":"2024-09-21T07:05:13.845960+0000","last_undegraded":"2024-09-21T07:05:13.845960+0000","last_fullsized":"2024-09-21T07:05:13.845960+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.958465+0000","last_change":"2024-09-21T07:05:13.958382+0000","last_active":"2024-09-21T07:05:13.958465+0000","last_peered":"2024-09-21T07:05:13.958465+0000","last_clean":"2024-09-21T07:05:13.958465+0000","last_became_active":"2024-09-21T07:05:13.957963+0000","last_became_peered":"2024-09-21T07:05:13.957963+0000","last_unstale":"2024-09-21T07:05:13.958465+0000","last_undegraded":"2024-09-21T07:05:13.958465+0000","last_fullsized":"2024-09-21T07:05:13.958465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:43.538026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843829+0000","last_change":"2024-09-21T07:04:38.051857+0000","last_active":"2024-09-21T07:05:13.843829+0000","last_peered":"2024-09-21T07:05:13.843829+0000","last_clean":"2024-09-21T07:05:13.843829+0000","last_became_active":"2024-09-21T07:04:38.051364+0000","last_became_peered":"2024-09-21T07:04:38.051364+0000","last_unstale":"2024-09-21T07:05:13.843829+0000","last_undegraded":"2024-09-21T07:05:13.843829+0000","last_fullsized":"2024-09-21T07:05:13.843829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:48.718078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848088+0000","last_change":"2024-09-21T07:04:40.075163+0000","last_active":"2024-09-21T07:05:13.848088+0000","last_peered":"2024-09-21T07:05:13.848088+0000","last_clean":"2024-09-21T07:05:13.848088+0000","last_became_active":"2024-09-21T07:04:40.074784+0000","last_became_peered":"2024-09-21T07:04:40.074784+0000","last_unstale":"2024-09-21T07:05:13.848088+0000","last_undegraded":"2024-09-21T07:05:13.848088+0000","last_fullsized":"2024-09-21T07:05:13.848088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:40.334326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'1","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102026+0000","last_change":"2024-09-21T07:04:38.051940+0000","last_active":"2024-09-21T07:05:14.102026+0000","last_peered":"2024-09-21T07:05:14.102026+0000","last_clean":"2024-09-21T07:05:14.102026+0000","last_became_active":"2024-09-21T07:04:38.051300+0000","last_became_peered":"2024-09-21T07:04:38.051300+0000","last_unstale":"2024-09-21T07:05:14.102026+0000","last_undegraded":"2024-09-21T07:05:14.102026+0000","last_fullsized":"2024-09-21T07:05:14.102026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:36.703119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848185+0000","last_change":"2024-09-21T07:04:40.067171+0000","last_active":"2024-09-21T07:05:13.848185+0000","last_peered":"2024-09-21T07:05:13.848185+0000","last_clean":"2024-09-21T07:05:13.848185+0000","last_became_active":"2024-09-21T07:04:40.066801+0000","last_became_peered":"2024-09-21T07:04:40.066801+0000","last_unstale":"2024-09-21T07:05:13.848185+0000","last_undegraded":"2024-09-21T07:05:13.848185+0000","last_fullsized":"2024-09-21T07:05:13.848185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:30.885860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849989+0000","last_change":"2024-09-21T07:04:38.138427+0000","last_active":"2024-09-21T07:05:13.849989+0000","last_peered":"2024-09-21T07:05:13.849989+0000","last_clean":"2024-09-21T07:05:13.849989+0000","last_became_active":"2024-09-21T07:04:38.137983+0000","last_became_peered":"2024-09-21T07:04:38.137983+0000","last_unstale":"2024-09-21T07:05:13.849989+0000","last_undegraded":"2024-09-21T07:05:13.849989+0000","last_fullsized":"2024-09-21T07:05:13.849989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:43.544784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848397+0000","last_change":"2024-09-21T07:04:40.074114+0000","last_active":"2024-09-21T07:05:13.848397+0000","last_peered":"2024-09-21T07:05:13.848397+0000","last_clean":"2024-09-21T07:05:13.848397+0000","last_became_active":"2024-09-21T07:04:40.073736+0000","last_became_peered":"2024-09-21T07:04:40.073736+0000","last_unstale":"2024-09-21T07:05:13.848397+0000","last_undegraded":"2024-09-21T07:05:13.848397+0000","last_fullsized":"2024-09-21T07:05:13.848397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:42.735634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848305+0000","last_change":"2024-09-21T07:03:25.075453+0000","last_active":"2024-09-21T07:05:13.848305+0000","last_peered":"2024-09-21T07:05:13.848305+0000","last_clean":"2024-09-21T07:05:13.848305+0000","last_became_active":"2024-09-21T07:03:25.069192+0000","last_became_peered":"2024-09-21T07:03:25.069192+0000","last_unstale":"2024-09-21T07:05:13.848305+0000","last_undegraded":"2024-09-21T07:05:13.848305+0000","last_fullsized":"2024-09-21T07:05:13.848305+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_clean_scrub_stamp":"2024-09-21T06:59:59.393354+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:56.048484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'3","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957090+0000","last_change":"2024-09-21T07:04:38.051627+0000","last_active":"2024-09-21T07:05:13.957090+0000","last_peered":"2024-09-21T07:05:13.957090+0000","last_clean":"2024-09-21T07:05:13.957090+0000","last_became_active":"2024-09-21T07:04:38.050547+0000","last_became_peered":"2024-09-21T07:04:38.050547+0000","last_unstale":"2024-09-21T07:05:13.957090+0000","last_undegraded":"2024-09-21T07:05:13.957090+0000","last_fullsized":"2024-09-21T07:05:13.957090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:11.607629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849220+0000","last_change":"2024-09-21T07:04:40.065627+0000","last_active":"2024-09-21T07:05:13.849220+0000","last_peered":"2024-09-21T07:05:13.849220+0000","last_clean":"2024-09-21T07:05:13.849220+0000","last_became_active":"2024-09-21T07:04:40.065265+0000","last_became_peered":"2024-09-21T07:04:40.065265+0000","last_unstale":"2024-09-21T07:05:13.849220+0000","last_undegraded":"2024-09-21T07:05:13.849220+0000","last_fullsized":"2024-09-21T07:05:13.849220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:01.950229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848247+0000","last_change":"2024-09-21T07:04:38.052441+0000","last_active":"2024-09-21T07:05:13.848247+0000","last_peered":"2024-09-21T07:05:13.848247+0000","last_clean":"2024-09-21T07:05:13.848247+0000","last_became_active":"2024-09-21T07:04:38.052075+0000","last_became_peered":"2024-09-21T07:04:38.052075+0000","last_unstale":"2024-09-21T07:05:13.848247+0000","last_undegraded":"2024-09-21T07:05:13.848247+0000","last_fullsized":"2024-09-21T07:05:13.848247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.649120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843385+0000","last_change":"2024-09-21T07:04:40.066421+0000","last_active":"2024-09-21T07:05:13.843385+0000","last_peered":"2024-09-21T07:05:13.843385+0000","last_clean":"2024-09-21T07:05:13.843385+0000","last_became_active":"2024-09-21T07:04:40.066049+0000","last_became_peered":"2024-09-21T07:04:40.066049+0000","last_unstale":"2024-09-21T07:05:13.843385+0000","last_undegraded":"2024-09-21T07:05:13.843385+0000","last_fullsized":"2024-09-21T07:05:13.843385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:03.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'4","reported_seq":83,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:44.442485+0000","last_change":"2024-09-21T07:04:38.137231+0000","last_active":"2024-09-21T07:05:44.442485+0000","last_peered":"2024-09-21T07:05:44.442485+0000","last_clean":"2024-09-21T07:05:44.442485+0000","last_became_active":"2024-09-21T07:04:38.136854+0000","last_became_peered":"2024-09-21T07:04:38.136854+0000","last_unstale":"2024-09-21T07:05:44.442485+0000","last_undegraded":"2024-09-21T07:05:44.442485+0000","last_fullsized":"2024-09-21T07:05:44.442485+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:58.386863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101577+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:05:14.101577+0000","last_peered":"2024-09-21T07:05:14.101577+0000","last_clean":"2024-09-21T07:05:14.101577+0000","last_became_active":"2024-09-21T07:04:40.076144+0000","last_became_peered":"2024-09-21T07:04:40.076144+0000","last_unstale":"2024-09-21T07:05:14.101577+0000","last_undegraded":"2024-09-21T07:05:14.101577+0000","last_fullsized":"2024-09-21T07:05:14.101577+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:51.520464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848210+0000","last_change":"2024-09-21T07:04:38.048223+0000","last_active":"2024-09-21T07:05:13.848210+0000","last_peered":"2024-09-21T07:05:13.848210+0000","last_clean":"2024-09-21T07:05:13.848210+0000","last_became_active":"2024-09-21T07:04:38.047761+0000","last_became_peered":"2024-09-21T07:04:38.047761+0000","last_unstale":"2024-09-21T07:05:13.848210+0000","last_undegraded":"2024-09-21T07:05:13.848210+0000","last_fullsized":"2024-09-21T07:05:13.848210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:50.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903322+0000","last_change":"2024-09-21T07:04:40.076961+0000","last_active":"2024-09-21T07:05:13.903322+0000","last_peered":"2024-09-21T07:05:13.903322+0000","last_clean":"2024-09-21T07:05:13.903322+0000","last_became_active":"2024-09-21T07:04:40.076572+0000","last_became_peered":"2024-09-21T07:04:40.076572+0000","last_unstale":"2024-09-21T07:05:13.903322+0000","last_undegraded":"2024-09-21T07:05:13.903322+0000","last_fullsized":"2024-09-21T07:05:13.903322+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.688173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.850297+0000","last_change":"2024-09-21T07:05:13.850141+0000","last_active":"2024-09-21T07:05:13.850297+0000","last_peered":"2024-09-21T07:05:13.850297+0000","last_clean":"2024-09-21T07:05:13.850297+0000","last_became_active":"2024-09-21T07:05:13.849758+0000","last_became_peered":"2024-09-21T07:05:13.849758+0000","last_unstale":"2024-09-21T07:05:13.850297+0000","last_undegraded":"2024-09-21T07:05:13.850297+0000","last_fullsized":"2024-09-21T07:05:13.850297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:18.982043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903438+0000","last_change":"2024-09-21T07:04:40.064091+0000","last_active":"2024-09-21T07:05:13.903438+0000","last_peered":"2024-09-21T07:05:13.903438+0000","last_clean":"2024-09-21T07:05:13.903438+0000","last_became_active":"2024-09-21T07:04:40.063704+0000","last_became_peered":"2024-09-21T07:04:40.063704+0000","last_unstale":"2024-09-21T07:05:13.903438+0000","last_undegraded":"2024-09-21T07:05:13.903438+0000","last_fullsized":"2024-09-21T07:05:13.903438+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:35.838486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'1","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846231+0000","last_change":"2024-09-21T07:04:38.138326+0000","last_active":"2024-09-21T07:05:13.846231+0000","last_peered":"2024-09-21T07:05:13.846231+0000","last_clean":"2024-09-21T07:05:13.846231+0000","last_became_active":"2024-09-21T07:04:38.137933+0000","last_became_peered":"2024-09-21T07:04:38.137933+0000","last_unstale":"2024-09-21T07:05:13.846231+0000","last_undegraded":"2024-09-21T07:05:13.846231+0000","last_fullsized":"2024-09-21T07:05:13.846231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:32.569458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843769+0000","last_change":"2024-09-21T07:04:40.058661+0000","last_active":"2024-09-21T07:05:13.843769+0000","last_peered":"2024-09-21T07:05:13.843769+0000","last_clean":"2024-09-21T07:05:13.843769+0000","last_became_active":"2024-09-21T07:04:40.058198+0000","last_became_peered":"2024-09-21T07:04:40.058198+0000","last_unstale":"2024-09-21T07:05:13.843769+0000","last_undegraded":"2024-09-21T07:05:13.843769+0000","last_fullsized":"2024-09-21T07:05:13.843769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:17.876087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'10","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848023+0000","last_change":"2024-09-21T07:04:38.048742+0000","last_active":"2024-09-21T07:05:13.848023+0000","last_peered":"2024-09-21T07:05:13.848023+0000","last_clean":"2024-09-21T07:05:13.848023+0000","last_became_active":"2024-09-21T07:04:38.048360+0000","last_became_peered":"2024-09-21T07:04:38.048360+0000","last_unstale":"2024-09-21T07:05:13.848023+0000","last_undegraded":"2024-09-21T07:05:13.848023+0000","last_fullsized":"2024-09-21T07:05:13.848023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:00.977592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848964+0000","last_change":"2024-09-21T07:04:40.076235+0000","last_active":"2024-09-21T07:05:13.848964+0000","last_peered":"2024-09-21T07:05:13.848964+0000","last_clean":"2024-09-21T07:05:13.848964+0000","last_became_active":"2024-09-21T07:04:40.075888+0000","last_became_peered":"2024-09-21T07:04:40.075888+0000","last_unstale":"2024-09-21T07:05:13.848964+0000","last_undegraded":"2024-09-21T07:05:13.848964+0000","last_fullsized":"2024-09-21T07:05:13.848964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:21.277910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957187+0000","last_change":"2024-09-21T07:04:38.054023+0000","last_active":"2024-09-21T07:05:13.957187+0000","last_peered":"2024-09-21T07:05:13.957187+0000","last_clean":"2024-09-21T07:05:13.957187+0000","last_became_active":"2024-09-21T07:04:38.053621+0000","last_became_peered":"2024-09-21T07:04:38.053621+0000","last_unstale":"2024-09-21T07:05:13.957187+0000","last_undegraded":"2024-09-21T07:05:13.957187+0000","last_fullsized":"2024-09-21T07:05:13.957187+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:10.732857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.851517+0000","last_change":"2024-09-21T07:05:13.851419+0000","last_active":"2024-09-21T07:05:13.851517+0000","last_peered":"2024-09-21T07:05:13.851517+0000","last_clean":"2024-09-21T07:05:13.851517+0000","last_became_active":"2024-09-21T07:05:13.850967+0000","last_became_peered":"2024-09-21T07:05:13.850967+0000","last_unstale":"2024-09-21T07:05:13.851517+0000","last_undegraded":"2024-09-21T07:05:13.851517+0000","last_fullsized":"2024-09-21T07:05:13.851517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:05.395235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101771+0000","last_change":"2024-09-21T07:04:38.138336+0000","last_active":"2024-09-21T07:05:14.101771+0000","last_peered":"2024-09-21T07:05:14.101771+0000","last_clean":"2024-09-21T07:05:14.101771+0000","last_became_active":"2024-09-21T07:04:38.138002+0000","last_became_peered":"2024-09-21T07:04:38.138002+0000","last_unstale":"2024-09-21T07:05:14.101771+0000","last_undegraded":"2024-09-21T07:05:14.101771+0000","last_fullsized":"2024-09-21T07:05:14.101771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.594369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845532+0000","last_change":"2024-09-21T07:04:40.073385+0000","last_active":"2024-09-21T07:05:13.845532+0000","last_peered":"2024-09-21T07:05:13.845532+0000","last_clean":"2024-09-21T07:05:13.845532+0000","last_became_active":"2024-09-21T07:04:40.072962+0000","last_became_peered":"2024-09-21T07:04:40.072962+0000","last_unstale":"2024-09-21T07:05:13.845532+0000","last_undegraded":"2024-09-21T07:05:13.845532+0000","last_fullsized":"2024-09-21T07:05:13.845532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:14.656729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849148+0000","last_change":"2024-09-21T07:04:38.048141+0000","last_active":"2024-09-21T07:05:13.849148+0000","last_peered":"2024-09-21T07:05:13.849148+0000","last_clean":"2024-09-21T07:05:13.849148+0000","last_became_active":"2024-09-21T07:04:38.047717+0000","last_became_peered":"2024-09-21T07:04:38.047717+0000","last_unstale":"2024-09-21T07:05:13.849148+0000","last_undegraded":"2024-09-21T07:05:13.849148+0000","last_fullsized":"2024-09-21T07:05:13.849148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:55.920716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846855+0000","last_change":"2024-09-21T07:04:40.069741+0000","last_active":"2024-09-21T07:05:13.846855+0000","last_peered":"2024-09-21T07:05:13.846855+0000","last_clean":"2024-09-21T07:05:13.846855+0000","last_became_active":"2024-09-21T07:04:40.069256+0000","last_became_peered":"2024-09-21T07:04:40.069256+0000","last_unstale":"2024-09-21T07:05:13.846855+0000","last_undegraded":"2024-09-21T07:05:13.846855+0000","last_fullsized":"2024-09-21T07:05:13.846855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:50.484011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849468+0000","last_change":"2024-09-21T07:04:38.050014+0000","last_active":"2024-09-21T07:05:13.849468+0000","last_peered":"2024-09-21T07:05:13.849468+0000","last_clean":"2024-09-21T07:05:13.849468+0000","last_became_active":"2024-09-21T07:04:38.049277+0000","last_became_peered":"2024-09-21T07:04:38.049277+0000","last_unstale":"2024-09-21T07:05:13.849468+0000","last_undegraded":"2024-09-21T07:05:13.849468+0000","last_fullsized":"2024-09-21T07:05:13.849468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:43.365126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848901+0000","last_change":"2024-09-21T07:04:40.065254+0000","last_active":"2024-09-21T07:05:13.848901+0000","last_peered":"2024-09-21T07:05:13.848901+0000","last_clean":"2024-09-21T07:05:13.848901+0000","last_became_active":"2024-09-21T07:04:40.064660+0000","last_became_peered":"2024-09-21T07:04:40.064660+0000","last_unstale":"2024-09-21T07:05:13.848901+0000","last_undegraded":"2024-09-21T07:05:13.848901+0000","last_fullsized":"2024-09-21T07:05:13.848901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:05.731169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846418+0000","last_change":"2024-09-21T07:04:38.055323+0000","last_active":"2024-09-21T07:05:13.846418+0000","last_peered":"2024-09-21T07:05:13.846418+0000","last_clean":"2024-09-21T07:05:13.846418+0000","last_became_active":"2024-09-21T07:04:38.054953+0000","last_became_peered":"2024-09-21T07:04:38.054953+0000","last_unstale":"2024-09-21T07:05:13.846418+0000","last_undegraded":"2024-09-21T07:05:13.846418+0000","last_fullsized":"2024-09-21T07:05:13.846418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:47.009187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847944+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:05:13.847944+0000","last_peered":"2024-09-21T07:05:13.847944+0000","last_clean":"2024-09-21T07:05:13.847944+0000","last_became_active":"2024-09-21T07:04:40.069662+0000","last_became_peered":"2024-09-21T07:04:40.069662+0000","last_unstale":"2024-09-21T07:05:13.847944+0000","last_undegraded":"2024-09-21T07:05:13.847944+0000","last_fullsized":"2024-09-21T07:05:13.847944+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:44.556304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.103232+0000","last_change":"2024-09-21T07:05:14.103158+0000","last_active":"2024-09-21T07:05:14.103232+0000","last_peered":"2024-09-21T07:05:14.103232+0000","last_clean":"2024-09-21T07:05:14.103232+0000","last_became_active":"2024-09-21T07:05:14.102715+0000","last_became_peered":"2024-09-21T07:05:14.102715+0000","last_unstale":"2024-09-21T07:05:14.103232+0000","last_undegraded":"2024-09-21T07:05:14.103232+0000","last_fullsized":"2024-09-21T07:05:14.103232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:12.900730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846216+0000","last_change":"2024-09-21T07:04:38.055743+0000","last_active":"2024-09-21T07:05:13.846216+0000","last_peered":"2024-09-21T07:05:13.846216+0000","last_clean":"2024-09-21T07:05:13.846216+0000","last_became_active":"2024-09-21T07:04:38.055344+0000","last_became_peered":"2024-09-21T07:04:38.055344+0000","last_unstale":"2024-09-21T07:05:13.846216+0000","last_undegraded":"2024-09-21T07:05:13.846216+0000","last_fullsized":"2024-09-21T07:05:13.846216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:32.610947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101813+0000","last_change":"2024-09-21T07:04:40.069789+0000","last_active":"2024-09-21T07:05:14.101813+0000","last_peered":"2024-09-21T07:05:14.101813+0000","last_clean":"2024-09-21T07:05:14.101813+0000","last_became_active":"2024-09-21T07:04:40.069399+0000","last_became_peered":"2024-09-21T07:04:40.069399+0000","last_unstale":"2024-09-21T07:05:14.101813+0000","last_undegraded":"2024-09-21T07:05:14.101813+0000","last_fullsized":"2024-09-21T07:05:14.101813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:15.300569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'4","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.859479+0000","last_change":"2024-09-21T07:05:13.858967+0000","last_active":"2024-09-21T07:05:13.859479+0000","last_peered":"2024-09-21T07:05:13.859479+0000","last_clean":"2024-09-21T07:05:13.859479+0000","last_became_active":"2024-09-21T07:05:13.851111+0000","last_became_peered":"2024-09-21T07:05:13.851111+0000","last_unstale":"2024-09-21T07:05:13.859479+0000","last_undegraded":"2024-09-21T07:05:13.859479+0000","last_fullsized":"2024-09-21T07:05:13.859479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:43.396364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845431+0000","last_change":"2024-09-21T07:04:40.072590+0000","last_active":"2024-09-21T07:05:13.845431+0000","last_peered":"2024-09-21T07:05:13.845431+0000","last_clean":"2024-09-21T07:05:13.845431+0000","last_became_active":"2024-09-21T07:04:40.071776+0000","last_became_peered":"2024-09-21T07:04:40.071776+0000","last_unstale":"2024-09-21T07:05:13.845431+0000","last_undegraded":"2024-09-21T07:05:13.845431+0000","last_fullsized":"2024-09-21T07:05:13.845431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:41.742797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849144+0000","last_change":"2024-09-21T07:04:38.137558+0000","last_active":"2024-09-21T07:05:13.849144+0000","last_peered":"2024-09-21T07:05:13.849144+0000","last_clean":"2024-09-21T07:05:13.849144+0000","last_became_active":"2024-09-21T07:04:38.137173+0000","last_became_peered":"2024-09-21T07:04:38.137173+0000","last_unstale":"2024-09-21T07:05:13.849144+0000","last_undegraded":"2024-09-21T07:05:13.849144+0000","last_fullsized":"2024-09-21T07:05:13.849144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:18.624886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849005+0000","last_change":"2024-09-21T07:04:40.069596+0000","last_active":"2024-09-21T07:05:13.849005+0000","last_peered":"2024-09-21T07:05:13.849005+0000","last_clean":"2024-09-21T07:05:13.849005+0000","last_became_active":"2024-09-21T07:04:40.069095+0000","last_became_peered":"2024-09-21T07:04:40.069095+0000","last_unstale":"2024-09-21T07:05:13.849005+0000","last_undegraded":"2024-09-21T07:05:13.849005+0000","last_fullsized":"2024-09-21T07:05:13.849005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.139930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'9","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847897+0000","last_change":"2024-09-21T07:04:38.052552+0000","last_active":"2024-09-21T07:05:13.847897+0000","last_peered":"2024-09-21T07:05:13.847897+0000","last_clean":"2024-09-21T07:05:13.847897+0000","last_became_active":"2024-09-21T07:04:38.052074+0000","last_became_peered":"2024-09-21T07:04:38.052074+0000","last_unstale":"2024-09-21T07:05:13.847897+0000","last_undegraded":"2024-09-21T07:05:13.847897+0000","last_fullsized":"2024-09-21T07:05:13.847897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:59.280299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68947,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":351,"num_read_kb":248,"num_write":158,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206841,"data_compressed":5673,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":249413,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841563,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":802816,"data_stored":393690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037792,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":1050508,"data_compressed":38214,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201316,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":393926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":393846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561072,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":985385,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724596,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":806912,"data_stored":393315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920825,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":985069,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084351,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":811008,"data_stored":393752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":823296,"data_stored":393626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":459795,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":458445,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":394586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":65337,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66687,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66915,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:05:49.531 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:05:49.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:49.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:49.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:05:49.799 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:50.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/782082719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c0105300 msgr2=0x7fd3c010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/782082719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c0105300 0x7fd3c010d850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009900 tx=0x7fd3b002a410 comp rx=0 tx=0).stop 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/782082719 shutdown_connections 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/782082719 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c010de10 0x7fd3c0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/782082719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c0105300 0x7fd3c010d850 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/782082719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c01049b0 0x7fd3c0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/782082719 >> 172.21.15.28:0/782082719 conn(0x7fd3c0079730 msgr2=0x7fd3c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/782082719 shutdown_connections 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.326+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/782082719 wait complete. 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 Processor -- start 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 -- start start 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c0105300 0x7fd3c019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 0x7fd3c019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0113a70 con 0x7fd3c01049b0 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01138f0 con 0x7fd3c0105300 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.327+0000 7fd3c7a8e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0113bf0 con 0x7fd3c010de10 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34884/0 (socket says 172.21.15.28:34884) 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 -- 172.21.15.28:0/1210951764 learned_addr learned my addr 172.21.15.28:0/1210951764 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c5029640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c0105300 0x7fd3c019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c602b640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 0x7fd3c019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 -- 172.21.15.28:0/1210951764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 msgr2=0x7fd3c019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 0x7fd3c019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 -- 172.21.15.28:0/1210951764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c0105300 msgr2=0x7fd3c019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c0105300 0x7fd3c019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 -- 172.21.15.28:0/1210951764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c01a04b0 con 0x7fd3c01049b0 2024-09-21T07:05:50.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c602b640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 0x7fd3c019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c582a640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d950 tx=0x7fd3bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc017020 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3bc009c30 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c01a07a0 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00f6b0 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.328+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c01a6f00 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.329+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c0104dc0 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.331+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd3bc01a020 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.332+0000 7fd3b6ffd640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 0x7fd3ac0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.332+0000 7fd3c5029640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 0x7fd3ac0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.332+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd3bc0e73a0 con 0x7fd3c01049b0 2024-09-21T07:05:50.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.333+0000 7fd3c5029640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 0x7fd3ac0b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009230 tx=0x7fd3b0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:50.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.336+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3bc009de0 con 0x7fd3c01049b0 2024-09-21T07:05:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.521+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3c0063800 con 0x7fd3ac0b6620 2024-09-21T07:05:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.525+0000 7fd3b6ffd640 1 -- 172.21.15.28:0/1210951764 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7fd3c0063800 con 0x7fd3ac0b6620 2024-09-21T07:05:50.530 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:50.531 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-21T07:05:50.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 msgr2=0x7fd3ac0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:50.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 0x7fd3ac0b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009230 tx=0x7fd3b0031400 comp rx=0 tx=0).stop 2024-09-21T07:05:50.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 msgr2=0x7fd3c019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:50.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d950 tx=0x7fd3bc00de10 comp rx=0 tx=0).stop 2024-09-21T07:05:50.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 shutdown_connections 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fd3ac0b6620 0x7fd3ac0b8b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3c010de10 0x7fd3c019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3c0105300 0x7fd3c019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 --2- 172.21.15.28:0/1210951764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c01049b0 0x7fd3c019a540 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.528+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 >> 172.21.15.28:0/1210951764 conn(0x7fd3c0079730 msgr2=0x7fd3c0100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.529+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 shutdown_connections 2024-09-21T07:05:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:50.529+0000 7fd3c7a8e640 1 -- 172.21.15.28:0/1210951764 wait complete. 2024-09-21T07:05:51.272 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-21T07:05:50.278356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659549,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":452,"num_read_kb":322,"num_write":283,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371724,"kb_used_data":9936,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570100,"statfs":{"total":1151940427776,"available":1151559782400,"internally_reserved":0,"allocated":10174464,"data_stored":6695943,"data_compressed":114642,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003087"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847313+0000","last_change":"2024-09-21T07:04:40.072039+0000","last_active":"2024-09-21T07:05:13.847313+0000","last_peered":"2024-09-21T07:05:13.847313+0000","last_clean":"2024-09-21T07:05:13.847313+0000","last_became_active":"2024-09-21T07:04:40.071228+0000","last_became_peered":"2024-09-21T07:04:40.071228+0000","last_unstale":"2024-09-21T07:05:13.847313+0000","last_undegraded":"2024-09-21T07:05:13.847313+0000","last_fullsized":"2024-09-21T07:05:13.847313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:42.645145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845099+0000","last_change":"2024-09-21T07:04:40.062714+0000","last_active":"2024-09-21T07:05:13.845099+0000","last_peered":"2024-09-21T07:05:13.845099+0000","last_clean":"2024-09-21T07:05:13.845099+0000","last_became_active":"2024-09-21T07:04:40.062309+0000","last_became_peered":"2024-09-21T07:04:40.062309+0000","last_unstale":"2024-09-21T07:05:13.845099+0000","last_undegraded":"2024-09-21T07:05:13.845099+0000","last_fullsized":"2024-09-21T07:05:13.845099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.604991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845098+0000","last_change":"2024-09-21T07:04:40.071023+0000","last_active":"2024-09-21T07:05:13.845098+0000","last_peered":"2024-09-21T07:05:13.845098+0000","last_clean":"2024-09-21T07:05:13.845098+0000","last_became_active":"2024-09-21T07:04:40.069846+0000","last_became_peered":"2024-09-21T07:04:40.069846+0000","last_unstale":"2024-09-21T07:05:13.845098+0000","last_undegraded":"2024-09-21T07:05:13.845098+0000","last_fullsized":"2024-09-21T07:05:13.845098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:45.611132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.956993+0000","last_change":"2024-09-21T07:04:40.058144+0000","last_active":"2024-09-21T07:05:13.956993+0000","last_peered":"2024-09-21T07:05:13.956993+0000","last_clean":"2024-09-21T07:05:13.956993+0000","last_became_active":"2024-09-21T07:04:40.057753+0000","last_became_peered":"2024-09-21T07:04:40.057753+0000","last_unstale":"2024-09-21T07:05:13.956993+0000","last_undegraded":"2024-09-21T07:05:13.956993+0000","last_fullsized":"2024-09-21T07:05:13.956993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:37.578024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.851770+0000","last_change":"2024-09-21T07:05:13.851650+0000","last_active":"2024-09-21T07:05:13.851770+0000","last_peered":"2024-09-21T07:05:13.851770+0000","last_clean":"2024-09-21T07:05:13.851770+0000","last_became_active":"2024-09-21T07:05:13.851033+0000","last_became_peered":"2024-09-21T07:05:13.851033+0000","last_unstale":"2024-09-21T07:05:13.851770+0000","last_undegraded":"2024-09-21T07:05:13.851770+0000","last_fullsized":"2024-09-21T07:05:13.851770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:14.837851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903218+0000","last_change":"2024-09-21T07:04:40.076852+0000","last_active":"2024-09-21T07:05:13.903218+0000","last_peered":"2024-09-21T07:05:13.903218+0000","last_clean":"2024-09-21T07:05:13.903218+0000","last_became_active":"2024-09-21T07:04:40.076377+0000","last_became_peered":"2024-09-21T07:04:40.076377+0000","last_unstale":"2024-09-21T07:05:13.903218+0000","last_undegraded":"2024-09-21T07:05:13.903218+0000","last_fullsized":"2024-09-21T07:05:13.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:21.776048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847832+0000","last_change":"2024-09-21T07:04:40.075024+0000","last_active":"2024-09-21T07:05:13.847832+0000","last_peered":"2024-09-21T07:05:13.847832+0000","last_clean":"2024-09-21T07:05:13.847832+0000","last_became_active":"2024-09-21T07:04:40.074651+0000","last_became_peered":"2024-09-21T07:04:40.074651+0000","last_unstale":"2024-09-21T07:05:13.847832+0000","last_undegraded":"2024-09-21T07:05:13.847832+0000","last_fullsized":"2024-09-21T07:05:13.847832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:04.184336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848592+0000","last_change":"2024-09-21T07:04:40.067007+0000","last_active":"2024-09-21T07:05:13.848592+0000","last_peered":"2024-09-21T07:05:13.848592+0000","last_clean":"2024-09-21T07:05:13.848592+0000","last_became_active":"2024-09-21T07:04:40.065599+0000","last_became_peered":"2024-09-21T07:04:40.065599+0000","last_unstale":"2024-09-21T07:05:13.848592+0000","last_undegraded":"2024-09-21T07:05:13.848592+0000","last_fullsized":"2024-09-21T07:05:13.848592+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:45.868671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102279+0000","last_change":"2024-09-21T07:04:40.079713+0000","last_active":"2024-09-21T07:05:14.102279+0000","last_peered":"2024-09-21T07:05:14.102279+0000","last_clean":"2024-09-21T07:05:14.102279+0000","last_became_active":"2024-09-21T07:04:40.078983+0000","last_became_peered":"2024-09-21T07:04:40.078983+0000","last_unstale":"2024-09-21T07:05:14.102279+0000","last_undegraded":"2024-09-21T07:05:14.102279+0000","last_fullsized":"2024-09-21T07:05:14.102279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:32.077942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903625+0000","last_change":"2024-09-21T07:04:40.078249+0000","last_active":"2024-09-21T07:05:13.903625+0000","last_peered":"2024-09-21T07:05:13.903625+0000","last_clean":"2024-09-21T07:05:13.903625+0000","last_became_active":"2024-09-21T07:04:40.077882+0000","last_became_peered":"2024-09-21T07:04:40.077882+0000","last_unstale":"2024-09-21T07:05:13.903625+0000","last_undegraded":"2024-09-21T07:05:13.903625+0000","last_fullsized":"2024-09-21T07:05:13.903625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:32.360168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848302+0000","last_change":"2024-09-21T07:04:40.070979+0000","last_active":"2024-09-21T07:05:13.848302+0000","last_peered":"2024-09-21T07:05:13.848302+0000","last_clean":"2024-09-21T07:05:13.848302+0000","last_became_active":"2024-09-21T07:04:40.070592+0000","last_became_peered":"2024-09-21T07:04:40.070592+0000","last_unstale":"2024-09-21T07:05:13.848302+0000","last_undegraded":"2024-09-21T07:05:13.848302+0000","last_fullsized":"2024-09-21T07:05:13.848302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:36.224263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957034+0000","last_change":"2024-09-21T07:04:40.069650+0000","last_active":"2024-09-21T07:05:13.957034+0000","last_peered":"2024-09-21T07:05:13.957034+0000","last_clean":"2024-09-21T07:05:13.957034+0000","last_became_active":"2024-09-21T07:04:40.068885+0000","last_became_peered":"2024-09-21T07:04:40.068885+0000","last_unstale":"2024-09-21T07:05:13.957034+0000","last_undegraded":"2024-09-21T07:05:13.957034+0000","last_fullsized":"2024-09-21T07:05:13.957034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.187038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843811+0000","last_change":"2024-09-21T07:04:40.061852+0000","last_active":"2024-09-21T07:05:13.843811+0000","last_peered":"2024-09-21T07:05:13.843811+0000","last_clean":"2024-09-21T07:05:13.843811+0000","last_became_active":"2024-09-21T07:04:40.061490+0000","last_became_peered":"2024-09-21T07:04:40.061490+0000","last_unstale":"2024-09-21T07:05:13.843811+0000","last_undegraded":"2024-09-21T07:05:13.843811+0000","last_fullsized":"2024-09-21T07:05:13.843811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:43.570941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.844934+0000","last_change":"2024-09-21T07:04:40.066844+0000","last_active":"2024-09-21T07:05:13.844934+0000","last_peered":"2024-09-21T07:05:13.844934+0000","last_clean":"2024-09-21T07:05:13.844934+0000","last_became_active":"2024-09-21T07:04:40.066472+0000","last_became_peered":"2024-09-21T07:04:40.066472+0000","last_unstale":"2024-09-21T07:05:13.844934+0000","last_undegraded":"2024-09-21T07:05:13.844934+0000","last_fullsized":"2024-09-21T07:05:13.844934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:58.798270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.844913+0000","last_change":"2024-09-21T07:04:40.068856+0000","last_active":"2024-09-21T07:05:13.844913+0000","last_peered":"2024-09-21T07:05:13.844913+0000","last_clean":"2024-09-21T07:05:13.844913+0000","last_became_active":"2024-09-21T07:04:40.068483+0000","last_became_peered":"2024-09-21T07:04:40.068483+0000","last_unstale":"2024-09-21T07:05:13.844913+0000","last_undegraded":"2024-09-21T07:05:13.844913+0000","last_fullsized":"2024-09-21T07:05:13.844913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101660+0000","last_change":"2024-09-21T07:04:40.072565+0000","last_active":"2024-09-21T07:05:14.101660+0000","last_peered":"2024-09-21T07:05:14.101660+0000","last_clean":"2024-09-21T07:05:14.101660+0000","last_became_active":"2024-09-21T07:04:40.071464+0000","last_became_peered":"2024-09-21T07:04:40.071464+0000","last_unstale":"2024-09-21T07:05:14.101660+0000","last_undegraded":"2024-09-21T07:05:14.101660+0000","last_fullsized":"2024-09-21T07:05:14.101660+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.821627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847462+0000","last_change":"2024-09-21T07:04:40.071563+0000","last_active":"2024-09-21T07:05:13.847462+0000","last_peered":"2024-09-21T07:05:13.847462+0000","last_clean":"2024-09-21T07:05:13.847462+0000","last_became_active":"2024-09-21T07:04:40.070763+0000","last_became_peered":"2024-09-21T07:04:40.070763+0000","last_unstale":"2024-09-21T07:05:13.847462+0000","last_undegraded":"2024-09-21T07:05:13.847462+0000","last_fullsized":"2024-09-21T07:05:13.847462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:01.856385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847845+0000","last_change":"2024-09-21T07:04:40.071528+0000","last_active":"2024-09-21T07:05:13.847845+0000","last_peered":"2024-09-21T07:05:13.847845+0000","last_clean":"2024-09-21T07:05:13.847845+0000","last_became_active":"2024-09-21T07:04:40.071146+0000","last_became_peered":"2024-09-21T07:04:40.071146+0000","last_unstale":"2024-09-21T07:05:13.847845+0000","last_undegraded":"2024-09-21T07:05:13.847845+0000","last_fullsized":"2024-09-21T07:05:13.847845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:30.032226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849818+0000","last_change":"2024-09-21T07:04:40.066043+0000","last_active":"2024-09-21T07:05:13.849818+0000","last_peered":"2024-09-21T07:05:13.849818+0000","last_clean":"2024-09-21T07:05:13.849818+0000","last_became_active":"2024-09-21T07:04:40.065651+0000","last_became_peered":"2024-09-21T07:04:40.065651+0000","last_unstale":"2024-09-21T07:05:13.849818+0000","last_undegraded":"2024-09-21T07:05:13.849818+0000","last_fullsized":"2024-09-21T07:05:13.849818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:26.450331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847015+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:05:13.847015+0000","last_peered":"2024-09-21T07:05:13.847015+0000","last_clean":"2024-09-21T07:05:13.847015+0000","last_became_active":"2024-09-21T07:04:40.076129+0000","last_became_peered":"2024-09-21T07:04:40.076129+0000","last_unstale":"2024-09-21T07:05:13.847015+0000","last_undegraded":"2024-09-21T07:05:13.847015+0000","last_fullsized":"2024-09-21T07:05:13.847015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:14.019420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843824+0000","last_change":"2024-09-21T07:04:40.072299+0000","last_active":"2024-09-21T07:05:13.843824+0000","last_peered":"2024-09-21T07:05:13.843824+0000","last_clean":"2024-09-21T07:05:13.843824+0000","last_became_active":"2024-09-21T07:04:40.071883+0000","last_became_peered":"2024-09-21T07:04:40.071883+0000","last_unstale":"2024-09-21T07:05:13.843824+0000","last_undegraded":"2024-09-21T07:05:13.843824+0000","last_fullsized":"2024-09-21T07:05:13.843824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:20.065717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101782+0000","last_change":"2024-09-21T07:04:40.072016+0000","last_active":"2024-09-21T07:05:14.101782+0000","last_peered":"2024-09-21T07:05:14.101782+0000","last_clean":"2024-09-21T07:05:14.101782+0000","last_became_active":"2024-09-21T07:04:40.071543+0000","last_became_peered":"2024-09-21T07:04:40.071543+0000","last_unstale":"2024-09-21T07:05:14.101782+0000","last_undegraded":"2024-09-21T07:05:14.101782+0000","last_fullsized":"2024-09-21T07:05:14.101782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:28.427766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849139+0000","last_change":"2024-09-21T07:04:40.075354+0000","last_active":"2024-09-21T07:05:13.849139+0000","last_peered":"2024-09-21T07:05:13.849139+0000","last_clean":"2024-09-21T07:05:13.849139+0000","last_became_active":"2024-09-21T07:04:40.075037+0000","last_became_peered":"2024-09-21T07:04:40.075037+0000","last_unstale":"2024-09-21T07:05:13.849139+0000","last_undegraded":"2024-09-21T07:05:13.849139+0000","last_fullsized":"2024-09-21T07:05:13.849139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.473774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101507+0000","last_change":"2024-09-21T07:04:40.066252+0000","last_active":"2024-09-21T07:05:14.101507+0000","last_peered":"2024-09-21T07:05:14.101507+0000","last_clean":"2024-09-21T07:05:14.101507+0000","last_became_active":"2024-09-21T07:04:40.065907+0000","last_became_peered":"2024-09-21T07:04:40.065907+0000","last_unstale":"2024-09-21T07:05:14.101507+0000","last_undegraded":"2024-09-21T07:05:14.101507+0000","last_fullsized":"2024-09-21T07:05:14.101507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:21.807697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.853504+0000","last_change":"2024-09-21T07:05:13.853396+0000","last_active":"2024-09-21T07:05:13.853504+0000","last_peered":"2024-09-21T07:05:13.853504+0000","last_clean":"2024-09-21T07:05:13.853504+0000","last_became_active":"2024-09-21T07:05:13.852971+0000","last_became_peered":"2024-09-21T07:05:13.852971+0000","last_unstale":"2024-09-21T07:05:13.853504+0000","last_undegraded":"2024-09-21T07:05:13.853504+0000","last_fullsized":"2024-09-21T07:05:13.853504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849813+0000","last_change":"2024-09-21T07:04:40.069865+0000","last_active":"2024-09-21T07:05:13.849813+0000","last_peered":"2024-09-21T07:05:13.849813+0000","last_clean":"2024-09-21T07:05:13.849813+0000","last_became_active":"2024-09-21T07:04:40.069456+0000","last_became_peered":"2024-09-21T07:04:40.069456+0000","last_unstale":"2024-09-21T07:05:13.849813+0000","last_undegraded":"2024-09-21T07:05:13.849813+0000","last_fullsized":"2024-09-21T07:05:13.849813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:43.027682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847838+0000","last_change":"2024-09-21T07:04:40.065527+0000","last_active":"2024-09-21T07:05:13.847838+0000","last_peered":"2024-09-21T07:05:13.847838+0000","last_clean":"2024-09-21T07:05:13.847838+0000","last_became_active":"2024-09-21T07:04:40.065187+0000","last_became_peered":"2024-09-21T07:04:40.065187+0000","last_unstale":"2024-09-21T07:05:13.847838+0000","last_undegraded":"2024-09-21T07:05:13.847838+0000","last_fullsized":"2024-09-21T07:05:13.847838+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.615948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843646+0000","last_change":"2024-09-21T07:04:40.074025+0000","last_active":"2024-09-21T07:05:13.843646+0000","last_peered":"2024-09-21T07:05:13.843646+0000","last_clean":"2024-09-21T07:05:13.843646+0000","last_became_active":"2024-09-21T07:04:40.073669+0000","last_became_peered":"2024-09-21T07:04:40.073669+0000","last_unstale":"2024-09-21T07:05:13.843646+0000","last_undegraded":"2024-09-21T07:05:13.843646+0000","last_fullsized":"2024-09-21T07:05:13.843646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:22.863209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.850201+0000","last_change":"2024-09-21T07:05:13.850092+0000","last_active":"2024-09-21T07:05:13.850201+0000","last_peered":"2024-09-21T07:05:13.850201+0000","last_clean":"2024-09-21T07:05:13.850201+0000","last_became_active":"2024-09-21T07:05:13.849593+0000","last_became_peered":"2024-09-21T07:05:13.849593+0000","last_unstale":"2024-09-21T07:05:13.850201+0000","last_undegraded":"2024-09-21T07:05:13.850201+0000","last_fullsized":"2024-09-21T07:05:13.850201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:14.694956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849316+0000","last_change":"2024-09-21T07:04:40.065818+0000","last_active":"2024-09-21T07:05:13.849316+0000","last_peered":"2024-09-21T07:05:13.849316+0000","last_clean":"2024-09-21T07:05:13.849316+0000","last_became_active":"2024-09-21T07:04:40.065422+0000","last_became_peered":"2024-09-21T07:04:40.065422+0000","last_unstale":"2024-09-21T07:05:13.849316+0000","last_undegraded":"2024-09-21T07:05:13.849316+0000","last_fullsized":"2024-09-21T07:05:13.849316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:28.597574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849519+0000","last_change":"2024-09-21T07:04:40.064223+0000","last_active":"2024-09-21T07:05:13.849519+0000","last_peered":"2024-09-21T07:05:13.849519+0000","last_clean":"2024-09-21T07:05:13.849519+0000","last_became_active":"2024-09-21T07:04:40.057620+0000","last_became_peered":"2024-09-21T07:04:40.057620+0000","last_unstale":"2024-09-21T07:05:13.849519+0000","last_undegraded":"2024-09-21T07:05:13.849519+0000","last_fullsized":"2024-09-21T07:05:13.849519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:25.518187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846714+0000","last_change":"2024-09-21T07:04:40.070105+0000","last_active":"2024-09-21T07:05:13.846714+0000","last_peered":"2024-09-21T07:05:13.846714+0000","last_clean":"2024-09-21T07:05:13.846714+0000","last_became_active":"2024-09-21T07:04:40.068920+0000","last_became_peered":"2024-09-21T07:04:40.068920+0000","last_unstale":"2024-09-21T07:05:13.846714+0000","last_undegraded":"2024-09-21T07:05:13.846714+0000","last_fullsized":"2024-09-21T07:05:13.846714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:51.847607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845667+0000","last_change":"2024-09-21T07:04:40.064852+0000","last_active":"2024-09-21T07:05:13.845667+0000","last_peered":"2024-09-21T07:05:13.845667+0000","last_clean":"2024-09-21T07:05:13.845667+0000","last_became_active":"2024-09-21T07:04:40.064476+0000","last_became_peered":"2024-09-21T07:04:40.064476+0000","last_unstale":"2024-09-21T07:05:13.845667+0000","last_undegraded":"2024-09-21T07:05:13.845667+0000","last_fullsized":"2024-09-21T07:05:13.845667+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:45.579783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:47.447448+0000","last_change":"2024-09-21T07:04:38.052529+0000","last_active":"2024-09-21T07:05:47.447448+0000","last_peered":"2024-09-21T07:05:47.447448+0000","last_clean":"2024-09-21T07:05:47.447448+0000","last_became_active":"2024-09-21T07:04:38.052117+0000","last_became_peered":"2024-09-21T07:04:38.052117+0000","last_unstale":"2024-09-21T07:05:47.447448+0000","last_undegraded":"2024-09-21T07:05:47.447448+0000","last_fullsized":"2024-09-21T07:05:47.447448+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:06.454006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101720+0000","last_change":"2024-09-21T07:04:40.077259+0000","last_active":"2024-09-21T07:05:14.101720+0000","last_peered":"2024-09-21T07:05:14.101720+0000","last_clean":"2024-09-21T07:05:14.101720+0000","last_became_active":"2024-09-21T07:04:40.076911+0000","last_became_peered":"2024-09-21T07:04:40.076911+0000","last_unstale":"2024-09-21T07:05:14.101720+0000","last_undegraded":"2024-09-21T07:05:14.101720+0000","last_fullsized":"2024-09-21T07:05:14.101720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:08.410875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903272+0000","last_change":"2024-09-21T07:04:38.052545+0000","last_active":"2024-09-21T07:05:13.903272+0000","last_peered":"2024-09-21T07:05:13.903272+0000","last_clean":"2024-09-21T07:05:13.903272+0000","last_became_active":"2024-09-21T07:04:38.052115+0000","last_became_peered":"2024-09-21T07:04:38.052115+0000","last_unstale":"2024-09-21T07:05:13.903272+0000","last_undegraded":"2024-09-21T07:05:13.903272+0000","last_fullsized":"2024-09-21T07:05:13.903272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:45.021727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843388+0000","last_change":"2024-09-21T07:04:38.050595+0000","last_active":"2024-09-21T07:05:13.843388+0000","last_peered":"2024-09-21T07:05:13.843388+0000","last_clean":"2024-09-21T07:05:13.843388+0000","last_became_active":"2024-09-21T07:04:38.050206+0000","last_became_peered":"2024-09-21T07:04:38.050206+0000","last_unstale":"2024-09-21T07:05:13.843388+0000","last_undegraded":"2024-09-21T07:05:13.843388+0000","last_fullsized":"2024-09-21T07:05:13.843388+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:37.746521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848693+0000","last_change":"2024-09-21T07:04:40.075300+0000","last_active":"2024-09-21T07:05:13.848693+0000","last_peered":"2024-09-21T07:05:13.848693+0000","last_clean":"2024-09-21T07:05:13.848693+0000","last_became_active":"2024-09-21T07:04:40.074959+0000","last_became_peered":"2024-09-21T07:04:40.074959+0000","last_unstale":"2024-09-21T07:05:13.848693+0000","last_undegraded":"2024-09-21T07:05:13.848693+0000","last_fullsized":"2024-09-21T07:05:13.848693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:42.935716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101819+0000","last_change":"2024-09-21T07:04:38.056440+0000","last_active":"2024-09-21T07:05:14.101819+0000","last_peered":"2024-09-21T07:05:14.101819+0000","last_clean":"2024-09-21T07:05:14.101819+0000","last_became_active":"2024-09-21T07:04:38.055917+0000","last_became_peered":"2024-09-21T07:04:38.055917+0000","last_unstale":"2024-09-21T07:05:14.101819+0000","last_undegraded":"2024-09-21T07:05:14.101819+0000","last_fullsized":"2024-09-21T07:05:14.101819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:54.090537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847593+0000","last_change":"2024-09-21T07:04:40.061602+0000","last_active":"2024-09-21T07:05:13.847593+0000","last_peered":"2024-09-21T07:05:13.847593+0000","last_clean":"2024-09-21T07:05:13.847593+0000","last_became_active":"2024-09-21T07:04:40.061209+0000","last_became_peered":"2024-09-21T07:04:40.061209+0000","last_unstale":"2024-09-21T07:05:13.847593+0000","last_undegraded":"2024-09-21T07:05:13.847593+0000","last_fullsized":"2024-09-21T07:05:13.847593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:31.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'3","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:47.446573+0000","last_change":"2024-09-21T07:04:38.053231+0000","last_active":"2024-09-21T07:05:47.446573+0000","last_peered":"2024-09-21T07:05:47.446573+0000","last_clean":"2024-09-21T07:05:47.446573+0000","last_became_active":"2024-09-21T07:04:38.052824+0000","last_became_peered":"2024-09-21T07:04:38.052824+0000","last_unstale":"2024-09-21T07:05:47.446573+0000","last_undegraded":"2024-09-21T07:05:47.446573+0000","last_fullsized":"2024-09-21T07:05:47.446573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:44.168096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102139+0000","last_change":"2024-09-21T07:04:40.070107+0000","last_active":"2024-09-21T07:05:14.102139+0000","last_peered":"2024-09-21T07:05:14.102139+0000","last_clean":"2024-09-21T07:05:14.102139+0000","last_became_active":"2024-09-21T07:04:40.069649+0000","last_became_peered":"2024-09-21T07:04:40.069649+0000","last_unstale":"2024-09-21T07:05:14.102139+0000","last_undegraded":"2024-09-21T07:05:14.102139+0000","last_fullsized":"2024-09-21T07:05:14.102139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.824442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848014+0000","last_change":"2024-09-21T07:04:38.049413+0000","last_active":"2024-09-21T07:05:13.848014+0000","last_peered":"2024-09-21T07:05:13.848014+0000","last_clean":"2024-09-21T07:05:13.848014+0000","last_became_active":"2024-09-21T07:04:38.049034+0000","last_became_peered":"2024-09-21T07:04:38.049034+0000","last_unstale":"2024-09-21T07:05:13.848014+0000","last_undegraded":"2024-09-21T07:05:13.848014+0000","last_fullsized":"2024-09-21T07:05:13.848014+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.866543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845455+0000","last_change":"2024-09-21T07:04:40.075411+0000","last_active":"2024-09-21T07:05:13.845455+0000","last_peered":"2024-09-21T07:05:13.845455+0000","last_clean":"2024-09-21T07:05:13.845455+0000","last_became_active":"2024-09-21T07:04:40.074410+0000","last_became_peered":"2024-09-21T07:04:40.074410+0000","last_unstale":"2024-09-21T07:05:13.845455+0000","last_undegraded":"2024-09-21T07:05:13.845455+0000","last_fullsized":"2024-09-21T07:05:13.845455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:15.685477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101877+0000","last_change":"2024-09-21T07:04:38.138349+0000","last_active":"2024-09-21T07:05:14.101877+0000","last_peered":"2024-09-21T07:05:14.101877+0000","last_clean":"2024-09-21T07:05:14.101877+0000","last_became_active":"2024-09-21T07:04:38.137934+0000","last_became_peered":"2024-09-21T07:04:38.137934+0000","last_unstale":"2024-09-21T07:05:14.101877+0000","last_undegraded":"2024-09-21T07:05:14.101877+0000","last_fullsized":"2024-09-21T07:05:14.101877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.963760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101853+0000","last_change":"2024-09-21T07:04:40.076072+0000","last_active":"2024-09-21T07:05:14.101853+0000","last_peered":"2024-09-21T07:05:14.101853+0000","last_clean":"2024-09-21T07:05:14.101853+0000","last_became_active":"2024-09-21T07:04:40.075637+0000","last_became_peered":"2024-09-21T07:04:40.075637+0000","last_unstale":"2024-09-21T07:05:14.101853+0000","last_undegraded":"2024-09-21T07:05:14.101853+0000","last_fullsized":"2024-09-21T07:05:14.101853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:52.272797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'27","reported_seq":175,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:48.448297+0000","last_change":"2024-09-21T07:04:38.052777+0000","last_active":"2024-09-21T07:05:48.448297+0000","last_peered":"2024-09-21T07:05:48.448297+0000","last_clean":"2024-09-21T07:05:48.448297+0000","last_became_active":"2024-09-21T07:04:38.052319+0000","last_became_peered":"2024-09-21T07:04:38.052319+0000","last_unstale":"2024-09-21T07:05:48.448297+0000","last_undegraded":"2024-09-21T07:05:48.448297+0000","last_fullsized":"2024-09-21T07:05:48.448297+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:26.124318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65337,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":28,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845964+0000","last_change":"2024-09-21T07:04:40.073693+0000","last_active":"2024-09-21T07:05:13.845964+0000","last_peered":"2024-09-21T07:05:13.845964+0000","last_clean":"2024-09-21T07:05:13.845964+0000","last_became_active":"2024-09-21T07:04:40.073362+0000","last_became_peered":"2024-09-21T07:04:40.073362+0000","last_unstale":"2024-09-21T07:05:13.845964+0000","last_undegraded":"2024-09-21T07:05:13.845964+0000","last_fullsized":"2024-09-21T07:05:13.845964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:47.193733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'6","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849782+0000","last_change":"2024-09-21T07:04:38.052881+0000","last_active":"2024-09-21T07:05:13.849782+0000","last_peered":"2024-09-21T07:05:13.849782+0000","last_clean":"2024-09-21T07:05:13.849782+0000","last_became_active":"2024-09-21T07:04:38.052499+0000","last_became_peered":"2024-09-21T07:04:38.052499+0000","last_unstale":"2024-09-21T07:05:13.849782+0000","last_undegraded":"2024-09-21T07:05:13.849782+0000","last_fullsized":"2024-09-21T07:05:13.849782+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.871624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843445+0000","last_change":"2024-09-21T07:04:40.070165+0000","last_active":"2024-09-21T07:05:13.843445+0000","last_peered":"2024-09-21T07:05:13.843445+0000","last_clean":"2024-09-21T07:05:13.843445+0000","last_became_active":"2024-09-21T07:04:40.068422+0000","last_became_peered":"2024-09-21T07:04:40.068422+0000","last_unstale":"2024-09-21T07:05:13.843445+0000","last_undegraded":"2024-09-21T07:05:13.843445+0000","last_fullsized":"2024-09-21T07:05:13.843445+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:09.593392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101770+0000","last_change":"2024-09-21T07:04:38.053713+0000","last_active":"2024-09-21T07:05:14.101770+0000","last_peered":"2024-09-21T07:05:14.101770+0000","last_clean":"2024-09-21T07:05:14.101770+0000","last_became_active":"2024-09-21T07:04:38.053283+0000","last_became_peered":"2024-09-21T07:04:38.053283+0000","last_unstale":"2024-09-21T07:05:14.101770+0000","last_undegraded":"2024-09-21T07:05:14.101770+0000","last_fullsized":"2024-09-21T07:05:14.101770+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:53.588142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848550+0000","last_change":"2024-09-21T07:04:40.080396+0000","last_active":"2024-09-21T07:05:13.848550+0000","last_peered":"2024-09-21T07:05:13.848550+0000","last_clean":"2024-09-21T07:05:13.848550+0000","last_became_active":"2024-09-21T07:04:40.080040+0000","last_became_peered":"2024-09-21T07:04:40.080040+0000","last_unstale":"2024-09-21T07:05:13.848550+0000","last_undegraded":"2024-09-21T07:05:13.848550+0000","last_fullsized":"2024-09-21T07:05:13.848550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:26.638672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'3","reported_seq":87,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:47.447517+0000","last_change":"2024-09-21T07:04:38.051776+0000","last_active":"2024-09-21T07:05:47.447517+0000","last_peered":"2024-09-21T07:05:47.447517+0000","last_clean":"2024-09-21T07:05:47.447517+0000","last_became_active":"2024-09-21T07:04:38.048551+0000","last_became_peered":"2024-09-21T07:04:38.048551+0000","last_unstale":"2024-09-21T07:05:47.447517+0000","last_undegraded":"2024-09-21T07:05:47.447517+0000","last_fullsized":"2024-09-21T07:05:47.447517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.640949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847741+0000","last_change":"2024-09-21T07:04:40.066595+0000","last_active":"2024-09-21T07:05:13.847741+0000","last_peered":"2024-09-21T07:05:13.847741+0000","last_clean":"2024-09-21T07:05:13.847741+0000","last_became_active":"2024-09-21T07:04:40.063872+0000","last_became_peered":"2024-09-21T07:04:40.063872+0000","last_unstale":"2024-09-21T07:05:13.847741+0000","last_undegraded":"2024-09-21T07:05:13.847741+0000","last_fullsized":"2024-09-21T07:05:13.847741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:37.820834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'15","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845504+0000","last_change":"2024-09-21T07:04:38.138472+0000","last_active":"2024-09-21T07:05:13.845504+0000","last_peered":"2024-09-21T07:05:13.845504+0000","last_clean":"2024-09-21T07:05:13.845504+0000","last_became_active":"2024-09-21T07:04:38.138095+0000","last_became_peered":"2024-09-21T07:04:38.138095+0000","last_unstale":"2024-09-21T07:05:13.845504+0000","last_undegraded":"2024-09-21T07:05:13.845504+0000","last_fullsized":"2024-09-21T07:05:13.845504+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:50.789021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101603+0000","last_change":"2024-09-21T07:04:40.076508+0000","last_active":"2024-09-21T07:05:14.101603+0000","last_peered":"2024-09-21T07:05:14.101603+0000","last_clean":"2024-09-21T07:05:14.101603+0000","last_became_active":"2024-09-21T07:04:40.076115+0000","last_became_peered":"2024-09-21T07:04:40.076115+0000","last_unstale":"2024-09-21T07:05:14.101603+0000","last_undegraded":"2024-09-21T07:05:14.101603+0000","last_fullsized":"2024-09-21T07:05:14.101603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:19.803762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845960+0000","last_change":"2024-09-21T07:04:38.056502+0000","last_active":"2024-09-21T07:05:13.845960+0000","last_peered":"2024-09-21T07:05:13.845960+0000","last_clean":"2024-09-21T07:05:13.845960+0000","last_became_active":"2024-09-21T07:04:38.056146+0000","last_became_peered":"2024-09-21T07:04:38.056146+0000","last_unstale":"2024-09-21T07:05:13.845960+0000","last_undegraded":"2024-09-21T07:05:13.845960+0000","last_fullsized":"2024-09-21T07:05:13.845960+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:23.677403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.958465+0000","last_change":"2024-09-21T07:05:13.958382+0000","last_active":"2024-09-21T07:05:13.958465+0000","last_peered":"2024-09-21T07:05:13.958465+0000","last_clean":"2024-09-21T07:05:13.958465+0000","last_became_active":"2024-09-21T07:05:13.957963+0000","last_became_peered":"2024-09-21T07:05:13.957963+0000","last_unstale":"2024-09-21T07:05:13.958465+0000","last_undegraded":"2024-09-21T07:05:13.958465+0000","last_fullsized":"2024-09-21T07:05:13.958465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:43.538026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843829+0000","last_change":"2024-09-21T07:04:38.051857+0000","last_active":"2024-09-21T07:05:13.843829+0000","last_peered":"2024-09-21T07:05:13.843829+0000","last_clean":"2024-09-21T07:05:13.843829+0000","last_became_active":"2024-09-21T07:04:38.051364+0000","last_became_peered":"2024-09-21T07:04:38.051364+0000","last_unstale":"2024-09-21T07:05:13.843829+0000","last_undegraded":"2024-09-21T07:05:13.843829+0000","last_fullsized":"2024-09-21T07:05:13.843829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:48.718078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848088+0000","last_change":"2024-09-21T07:04:40.075163+0000","last_active":"2024-09-21T07:05:13.848088+0000","last_peered":"2024-09-21T07:05:13.848088+0000","last_clean":"2024-09-21T07:05:13.848088+0000","last_became_active":"2024-09-21T07:04:40.074784+0000","last_became_peered":"2024-09-21T07:04:40.074784+0000","last_unstale":"2024-09-21T07:05:13.848088+0000","last_undegraded":"2024-09-21T07:05:13.848088+0000","last_fullsized":"2024-09-21T07:05:13.848088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:40.334326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'1","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.102026+0000","last_change":"2024-09-21T07:04:38.051940+0000","last_active":"2024-09-21T07:05:14.102026+0000","last_peered":"2024-09-21T07:05:14.102026+0000","last_clean":"2024-09-21T07:05:14.102026+0000","last_became_active":"2024-09-21T07:04:38.051300+0000","last_became_peered":"2024-09-21T07:04:38.051300+0000","last_unstale":"2024-09-21T07:05:14.102026+0000","last_undegraded":"2024-09-21T07:05:14.102026+0000","last_fullsized":"2024-09-21T07:05:14.102026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:36.703119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848185+0000","last_change":"2024-09-21T07:04:40.067171+0000","last_active":"2024-09-21T07:05:13.848185+0000","last_peered":"2024-09-21T07:05:13.848185+0000","last_clean":"2024-09-21T07:05:13.848185+0000","last_became_active":"2024-09-21T07:04:40.066801+0000","last_became_peered":"2024-09-21T07:04:40.066801+0000","last_unstale":"2024-09-21T07:05:13.848185+0000","last_undegraded":"2024-09-21T07:05:13.848185+0000","last_fullsized":"2024-09-21T07:05:13.848185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:30.885860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849989+0000","last_change":"2024-09-21T07:04:38.138427+0000","last_active":"2024-09-21T07:05:13.849989+0000","last_peered":"2024-09-21T07:05:13.849989+0000","last_clean":"2024-09-21T07:05:13.849989+0000","last_became_active":"2024-09-21T07:04:38.137983+0000","last_became_peered":"2024-09-21T07:04:38.137983+0000","last_unstale":"2024-09-21T07:05:13.849989+0000","last_undegraded":"2024-09-21T07:05:13.849989+0000","last_fullsized":"2024-09-21T07:05:13.849989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:43.544784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848397+0000","last_change":"2024-09-21T07:04:40.074114+0000","last_active":"2024-09-21T07:05:13.848397+0000","last_peered":"2024-09-21T07:05:13.848397+0000","last_clean":"2024-09-21T07:05:13.848397+0000","last_became_active":"2024-09-21T07:04:40.073736+0000","last_became_peered":"2024-09-21T07:04:40.073736+0000","last_unstale":"2024-09-21T07:05:13.848397+0000","last_undegraded":"2024-09-21T07:05:13.848397+0000","last_fullsized":"2024-09-21T07:05:13.848397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:42.735634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848305+0000","last_change":"2024-09-21T07:03:25.075453+0000","last_active":"2024-09-21T07:05:13.848305+0000","last_peered":"2024-09-21T07:05:13.848305+0000","last_clean":"2024-09-21T07:05:13.848305+0000","last_became_active":"2024-09-21T07:03:25.069192+0000","last_became_peered":"2024-09-21T07:03:25.069192+0000","last_unstale":"2024-09-21T07:05:13.848305+0000","last_undegraded":"2024-09-21T07:05:13.848305+0000","last_fullsized":"2024-09-21T07:05:13.848305+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:59:59.393354+0000","last_clean_scrub_stamp":"2024-09-21T06:59:59.393354+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:56.048484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'3","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957090+0000","last_change":"2024-09-21T07:04:38.051627+0000","last_active":"2024-09-21T07:05:13.957090+0000","last_peered":"2024-09-21T07:05:13.957090+0000","last_clean":"2024-09-21T07:05:13.957090+0000","last_became_active":"2024-09-21T07:04:38.050547+0000","last_became_peered":"2024-09-21T07:04:38.050547+0000","last_unstale":"2024-09-21T07:05:13.957090+0000","last_undegraded":"2024-09-21T07:05:13.957090+0000","last_fullsized":"2024-09-21T07:05:13.957090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:11.607629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849220+0000","last_change":"2024-09-21T07:04:40.065627+0000","last_active":"2024-09-21T07:05:13.849220+0000","last_peered":"2024-09-21T07:05:13.849220+0000","last_clean":"2024-09-21T07:05:13.849220+0000","last_became_active":"2024-09-21T07:04:40.065265+0000","last_became_peered":"2024-09-21T07:04:40.065265+0000","last_unstale":"2024-09-21T07:05:13.849220+0000","last_undegraded":"2024-09-21T07:05:13.849220+0000","last_fullsized":"2024-09-21T07:05:13.849220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:01.950229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848247+0000","last_change":"2024-09-21T07:04:38.052441+0000","last_active":"2024-09-21T07:05:13.848247+0000","last_peered":"2024-09-21T07:05:13.848247+0000","last_clean":"2024-09-21T07:05:13.848247+0000","last_became_active":"2024-09-21T07:04:38.052075+0000","last_became_peered":"2024-09-21T07:04:38.052075+0000","last_unstale":"2024-09-21T07:05:13.848247+0000","last_undegraded":"2024-09-21T07:05:13.848247+0000","last_fullsized":"2024-09-21T07:05:13.848247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:45.649120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843385+0000","last_change":"2024-09-21T07:04:40.066421+0000","last_active":"2024-09-21T07:05:13.843385+0000","last_peered":"2024-09-21T07:05:13.843385+0000","last_clean":"2024-09-21T07:05:13.843385+0000","last_became_active":"2024-09-21T07:04:40.066049+0000","last_became_peered":"2024-09-21T07:04:40.066049+0000","last_unstale":"2024-09-21T07:05:13.843385+0000","last_undegraded":"2024-09-21T07:05:13.843385+0000","last_fullsized":"2024-09-21T07:05:13.843385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:03.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'4","reported_seq":83,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:44.442485+0000","last_change":"2024-09-21T07:04:38.137231+0000","last_active":"2024-09-21T07:05:44.442485+0000","last_peered":"2024-09-21T07:05:44.442485+0000","last_clean":"2024-09-21T07:05:44.442485+0000","last_became_active":"2024-09-21T07:04:38.136854+0000","last_became_peered":"2024-09-21T07:04:38.136854+0000","last_unstale":"2024-09-21T07:05:44.442485+0000","last_undegraded":"2024-09-21T07:05:44.442485+0000","last_fullsized":"2024-09-21T07:05:44.442485+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:58.386863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101577+0000","last_change":"2024-09-21T07:04:40.076573+0000","last_active":"2024-09-21T07:05:14.101577+0000","last_peered":"2024-09-21T07:05:14.101577+0000","last_clean":"2024-09-21T07:05:14.101577+0000","last_became_active":"2024-09-21T07:04:40.076144+0000","last_became_peered":"2024-09-21T07:04:40.076144+0000","last_unstale":"2024-09-21T07:05:14.101577+0000","last_undegraded":"2024-09-21T07:05:14.101577+0000","last_fullsized":"2024-09-21T07:05:14.101577+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:51.520464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848210+0000","last_change":"2024-09-21T07:04:38.048223+0000","last_active":"2024-09-21T07:05:13.848210+0000","last_peered":"2024-09-21T07:05:13.848210+0000","last_clean":"2024-09-21T07:05:13.848210+0000","last_became_active":"2024-09-21T07:04:38.047761+0000","last_became_peered":"2024-09-21T07:04:38.047761+0000","last_unstale":"2024-09-21T07:05:13.848210+0000","last_undegraded":"2024-09-21T07:05:13.848210+0000","last_fullsized":"2024-09-21T07:05:13.848210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:50.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903322+0000","last_change":"2024-09-21T07:04:40.076961+0000","last_active":"2024-09-21T07:05:13.903322+0000","last_peered":"2024-09-21T07:05:13.903322+0000","last_clean":"2024-09-21T07:05:13.903322+0000","last_became_active":"2024-09-21T07:04:40.076572+0000","last_became_peered":"2024-09-21T07:04:40.076572+0000","last_unstale":"2024-09-21T07:05:13.903322+0000","last_undegraded":"2024-09-21T07:05:13.903322+0000","last_fullsized":"2024-09-21T07:05:13.903322+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:52.688173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.850297+0000","last_change":"2024-09-21T07:05:13.850141+0000","last_active":"2024-09-21T07:05:13.850297+0000","last_peered":"2024-09-21T07:05:13.850297+0000","last_clean":"2024-09-21T07:05:13.850297+0000","last_became_active":"2024-09-21T07:05:13.849758+0000","last_became_peered":"2024-09-21T07:05:13.849758+0000","last_unstale":"2024-09-21T07:05:13.850297+0000","last_undegraded":"2024-09-21T07:05:13.850297+0000","last_fullsized":"2024-09-21T07:05:13.850297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:18.982043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.903438+0000","last_change":"2024-09-21T07:04:40.064091+0000","last_active":"2024-09-21T07:05:13.903438+0000","last_peered":"2024-09-21T07:05:13.903438+0000","last_clean":"2024-09-21T07:05:13.903438+0000","last_became_active":"2024-09-21T07:04:40.063704+0000","last_became_peered":"2024-09-21T07:04:40.063704+0000","last_unstale":"2024-09-21T07:05:13.903438+0000","last_undegraded":"2024-09-21T07:05:13.903438+0000","last_fullsized":"2024-09-21T07:05:13.903438+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:35.838486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'1","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846231+0000","last_change":"2024-09-21T07:04:38.138326+0000","last_active":"2024-09-21T07:05:13.846231+0000","last_peered":"2024-09-21T07:05:13.846231+0000","last_clean":"2024-09-21T07:05:13.846231+0000","last_became_active":"2024-09-21T07:04:38.137933+0000","last_became_peered":"2024-09-21T07:04:38.137933+0000","last_unstale":"2024-09-21T07:05:13.846231+0000","last_undegraded":"2024-09-21T07:05:13.846231+0000","last_fullsized":"2024-09-21T07:05:13.846231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:32.569458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.843769+0000","last_change":"2024-09-21T07:04:40.058661+0000","last_active":"2024-09-21T07:05:13.843769+0000","last_peered":"2024-09-21T07:05:13.843769+0000","last_clean":"2024-09-21T07:05:13.843769+0000","last_became_active":"2024-09-21T07:04:40.058198+0000","last_became_peered":"2024-09-21T07:04:40.058198+0000","last_unstale":"2024-09-21T07:05:13.843769+0000","last_undegraded":"2024-09-21T07:05:13.843769+0000","last_fullsized":"2024-09-21T07:05:13.843769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:17.876087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'10","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848023+0000","last_change":"2024-09-21T07:04:38.048742+0000","last_active":"2024-09-21T07:05:13.848023+0000","last_peered":"2024-09-21T07:05:13.848023+0000","last_clean":"2024-09-21T07:05:13.848023+0000","last_became_active":"2024-09-21T07:04:38.048360+0000","last_became_peered":"2024-09-21T07:04:38.048360+0000","last_unstale":"2024-09-21T07:05:13.848023+0000","last_undegraded":"2024-09-21T07:05:13.848023+0000","last_fullsized":"2024-09-21T07:05:13.848023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:00.977592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848964+0000","last_change":"2024-09-21T07:04:40.076235+0000","last_active":"2024-09-21T07:05:13.848964+0000","last_peered":"2024-09-21T07:05:13.848964+0000","last_clean":"2024-09-21T07:05:13.848964+0000","last_became_active":"2024-09-21T07:04:40.075888+0000","last_became_peered":"2024-09-21T07:04:40.075888+0000","last_unstale":"2024-09-21T07:05:13.848964+0000","last_undegraded":"2024-09-21T07:05:13.848964+0000","last_fullsized":"2024-09-21T07:05:13.848964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:21.277910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.957187+0000","last_change":"2024-09-21T07:04:38.054023+0000","last_active":"2024-09-21T07:05:13.957187+0000","last_peered":"2024-09-21T07:05:13.957187+0000","last_clean":"2024-09-21T07:05:13.957187+0000","last_became_active":"2024-09-21T07:04:38.053621+0000","last_became_peered":"2024-09-21T07:04:38.053621+0000","last_unstale":"2024-09-21T07:05:13.957187+0000","last_undegraded":"2024-09-21T07:05:13.957187+0000","last_fullsized":"2024-09-21T07:05:13.957187+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:10.732857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.851517+0000","last_change":"2024-09-21T07:05:13.851419+0000","last_active":"2024-09-21T07:05:13.851517+0000","last_peered":"2024-09-21T07:05:13.851517+0000","last_clean":"2024-09-21T07:05:13.851517+0000","last_became_active":"2024-09-21T07:05:13.850967+0000","last_became_peered":"2024-09-21T07:05:13.850967+0000","last_unstale":"2024-09-21T07:05:13.851517+0000","last_undegraded":"2024-09-21T07:05:13.851517+0000","last_fullsized":"2024-09-21T07:05:13.851517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:05.395235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101771+0000","last_change":"2024-09-21T07:04:38.138336+0000","last_active":"2024-09-21T07:05:14.101771+0000","last_peered":"2024-09-21T07:05:14.101771+0000","last_clean":"2024-09-21T07:05:14.101771+0000","last_became_active":"2024-09-21T07:04:38.138002+0000","last_became_peered":"2024-09-21T07:04:38.138002+0000","last_unstale":"2024-09-21T07:05:14.101771+0000","last_undegraded":"2024-09-21T07:05:14.101771+0000","last_fullsized":"2024-09-21T07:05:14.101771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.594369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845532+0000","last_change":"2024-09-21T07:04:40.073385+0000","last_active":"2024-09-21T07:05:13.845532+0000","last_peered":"2024-09-21T07:05:13.845532+0000","last_clean":"2024-09-21T07:05:13.845532+0000","last_became_active":"2024-09-21T07:04:40.072962+0000","last_became_peered":"2024-09-21T07:04:40.072962+0000","last_unstale":"2024-09-21T07:05:13.845532+0000","last_undegraded":"2024-09-21T07:05:13.845532+0000","last_fullsized":"2024-09-21T07:05:13.845532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:14.656729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849148+0000","last_change":"2024-09-21T07:04:38.048141+0000","last_active":"2024-09-21T07:05:13.849148+0000","last_peered":"2024-09-21T07:05:13.849148+0000","last_clean":"2024-09-21T07:05:13.849148+0000","last_became_active":"2024-09-21T07:04:38.047717+0000","last_became_peered":"2024-09-21T07:04:38.047717+0000","last_unstale":"2024-09-21T07:05:13.849148+0000","last_undegraded":"2024-09-21T07:05:13.849148+0000","last_fullsized":"2024-09-21T07:05:13.849148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:55.920716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846855+0000","last_change":"2024-09-21T07:04:40.069741+0000","last_active":"2024-09-21T07:05:13.846855+0000","last_peered":"2024-09-21T07:05:13.846855+0000","last_clean":"2024-09-21T07:05:13.846855+0000","last_became_active":"2024-09-21T07:04:40.069256+0000","last_became_peered":"2024-09-21T07:04:40.069256+0000","last_unstale":"2024-09-21T07:05:13.846855+0000","last_undegraded":"2024-09-21T07:05:13.846855+0000","last_fullsized":"2024-09-21T07:05:13.846855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:50.484011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'1","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849468+0000","last_change":"2024-09-21T07:04:38.050014+0000","last_active":"2024-09-21T07:05:13.849468+0000","last_peered":"2024-09-21T07:05:13.849468+0000","last_clean":"2024-09-21T07:05:13.849468+0000","last_became_active":"2024-09-21T07:04:38.049277+0000","last_became_peered":"2024-09-21T07:04:38.049277+0000","last_unstale":"2024-09-21T07:05:13.849468+0000","last_undegraded":"2024-09-21T07:05:13.849468+0000","last_fullsized":"2024-09-21T07:05:13.849468+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:43.365126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.848901+0000","last_change":"2024-09-21T07:04:40.065254+0000","last_active":"2024-09-21T07:05:13.848901+0000","last_peered":"2024-09-21T07:05:13.848901+0000","last_clean":"2024-09-21T07:05:13.848901+0000","last_became_active":"2024-09-21T07:04:40.064660+0000","last_became_peered":"2024-09-21T07:04:40.064660+0000","last_unstale":"2024-09-21T07:05:13.848901+0000","last_undegraded":"2024-09-21T07:05:13.848901+0000","last_fullsized":"2024-09-21T07:05:13.848901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:05.731169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846418+0000","last_change":"2024-09-21T07:04:38.055323+0000","last_active":"2024-09-21T07:05:13.846418+0000","last_peered":"2024-09-21T07:05:13.846418+0000","last_clean":"2024-09-21T07:05:13.846418+0000","last_became_active":"2024-09-21T07:04:38.054953+0000","last_became_peered":"2024-09-21T07:04:38.054953+0000","last_unstale":"2024-09-21T07:05:13.846418+0000","last_undegraded":"2024-09-21T07:05:13.846418+0000","last_fullsized":"2024-09-21T07:05:13.846418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:47.009187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847944+0000","last_change":"2024-09-21T07:04:40.070022+0000","last_active":"2024-09-21T07:05:13.847944+0000","last_peered":"2024-09-21T07:05:13.847944+0000","last_clean":"2024-09-21T07:05:13.847944+0000","last_became_active":"2024-09-21T07:04:40.069662+0000","last_became_peered":"2024-09-21T07:04:40.069662+0000","last_unstale":"2024-09-21T07:05:13.847944+0000","last_undegraded":"2024-09-21T07:05:13.847944+0000","last_fullsized":"2024-09-21T07:05:13.847944+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:44.556304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.103232+0000","last_change":"2024-09-21T07:05:14.103158+0000","last_active":"2024-09-21T07:05:14.103232+0000","last_peered":"2024-09-21T07:05:14.103232+0000","last_clean":"2024-09-21T07:05:14.103232+0000","last_became_active":"2024-09-21T07:05:14.102715+0000","last_became_peered":"2024-09-21T07:05:14.102715+0000","last_unstale":"2024-09-21T07:05:14.103232+0000","last_undegraded":"2024-09-21T07:05:14.103232+0000","last_fullsized":"2024-09-21T07:05:14.103232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:12.900730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.846216+0000","last_change":"2024-09-21T07:04:38.055743+0000","last_active":"2024-09-21T07:05:13.846216+0000","last_peered":"2024-09-21T07:05:13.846216+0000","last_clean":"2024-09-21T07:05:13.846216+0000","last_became_active":"2024-09-21T07:04:38.055344+0000","last_became_peered":"2024-09-21T07:04:38.055344+0000","last_unstale":"2024-09-21T07:05:13.846216+0000","last_undegraded":"2024-09-21T07:05:13.846216+0000","last_fullsized":"2024-09-21T07:05:13.846216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:32.610947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:14.101813+0000","last_change":"2024-09-21T07:04:40.069789+0000","last_active":"2024-09-21T07:05:14.101813+0000","last_peered":"2024-09-21T07:05:14.101813+0000","last_clean":"2024-09-21T07:05:14.101813+0000","last_became_active":"2024-09-21T07:04:40.069399+0000","last_became_peered":"2024-09-21T07:04:40.069399+0000","last_unstale":"2024-09-21T07:05:14.101813+0000","last_undegraded":"2024-09-21T07:05:14.101813+0000","last_fullsized":"2024-09-21T07:05:14.101813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:15.300569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'4","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.859479+0000","last_change":"2024-09-21T07:05:13.858967+0000","last_active":"2024-09-21T07:05:13.859479+0000","last_peered":"2024-09-21T07:05:13.859479+0000","last_clean":"2024-09-21T07:05:13.859479+0000","last_became_active":"2024-09-21T07:05:13.851111+0000","last_became_peered":"2024-09-21T07:05:13.851111+0000","last_unstale":"2024-09-21T07:05:13.859479+0000","last_undegraded":"2024-09-21T07:05:13.859479+0000","last_fullsized":"2024-09-21T07:05:13.859479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:43.396364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.845431+0000","last_change":"2024-09-21T07:04:40.072590+0000","last_active":"2024-09-21T07:05:13.845431+0000","last_peered":"2024-09-21T07:05:13.845431+0000","last_clean":"2024-09-21T07:05:13.845431+0000","last_became_active":"2024-09-21T07:04:40.071776+0000","last_became_peered":"2024-09-21T07:04:40.071776+0000","last_unstale":"2024-09-21T07:05:13.845431+0000","last_undegraded":"2024-09-21T07:05:13.845431+0000","last_fullsized":"2024-09-21T07:05:13.845431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:41.742797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849144+0000","last_change":"2024-09-21T07:04:38.137558+0000","last_active":"2024-09-21T07:05:13.849144+0000","last_peered":"2024-09-21T07:05:13.849144+0000","last_clean":"2024-09-21T07:05:13.849144+0000","last_became_active":"2024-09-21T07:04:38.137173+0000","last_became_peered":"2024-09-21T07:04:38.137173+0000","last_unstale":"2024-09-21T07:05:13.849144+0000","last_undegraded":"2024-09-21T07:05:13.849144+0000","last_fullsized":"2024-09-21T07:05:13.849144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:18.624886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.849005+0000","last_change":"2024-09-21T07:04:40.069596+0000","last_active":"2024-09-21T07:05:13.849005+0000","last_peered":"2024-09-21T07:05:13.849005+0000","last_clean":"2024-09-21T07:05:13.849005+0000","last_became_active":"2024-09-21T07:04:40.069095+0000","last_became_peered":"2024-09-21T07:04:40.069095+0000","last_unstale":"2024-09-21T07:05:13.849005+0000","last_undegraded":"2024-09-21T07:05:13.849005+0000","last_fullsized":"2024-09-21T07:05:13.849005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:39.038157+0000","last_clean_scrub_stamp":"2024-09-21T07:04:39.038157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:04.139930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'9","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:05:13.847897+0000","last_change":"2024-09-21T07:04:38.052552+0000","last_active":"2024-09-21T07:05:13.847897+0000","last_peered":"2024-09-21T07:05:13.847897+0000","last_clean":"2024-09-21T07:05:13.847897+0000","last_became_active":"2024-09-21T07:04:38.052074+0000","last_became_peered":"2024-09-21T07:04:38.052074+0000","last_unstale":"2024-09-21T07:05:13.847897+0000","last_undegraded":"2024-09-21T07:05:13.847897+0000","last_fullsized":"2024-09-21T07:05:13.847897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:04:37.029565+0000","last_clean_scrub_stamp":"2024-09-21T07:04:37.029565+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:59.280299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68947,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":158,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206841,"data_compressed":5673,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":249413,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841564,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":802816,"data_stored":393690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":60,"seq":257698037793,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":1050508,"data_compressed":38214,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201317,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":393926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":393846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561072,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":985385,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724596,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":806912,"data_stored":393315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920826,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":985069,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084352,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":811008,"data_stored":393752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":823296,"data_stored":393626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":459795,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":868352,"data_stored":458445,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":394586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34707,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36323,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":65337,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66687,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66915,"data_compressed":1891,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:05:51.276 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:05:51.276 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:05:51.276 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:05:51.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T07:05:51.540 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:51.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:51 smithi028 ceph-mon[31213]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:05:51.547 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:51 smithi028 ceph-mon[31213]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:51.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:51 smithi129 ceph-mon[34863]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:05:51.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:51 smithi129 ceph-mon[34863]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:51 smithi181 ceph-mon[34686]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:05:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:51 smithi181 ceph-mon[34686]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:05:52.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 -- 172.21.15.28:0/3186869717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c108cf0 msgr2=0x7f643c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:52.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 --2- 172.21.15.28:0/3186869717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c108cf0 0x7f643c10f520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6434009ca0 tx=0x7f643402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 -- 172.21.15.28:0/3186869717 shutdown_connections 2024-09-21T07:05:52.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 --2- 172.21.15.28:0/3186869717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c108cf0 0x7f643c10f520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 --2- 172.21.15.28:0/3186869717 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c1083a0 0x7f643c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 --2- 172.21.15.28:0/3186869717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c102a60 0x7f643c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 -- 172.21.15.28:0/3186869717 >> 172.21.15.28:0/3186869717 conn(0x7f643c079730 msgr2=0x7f643c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 -- 172.21.15.28:0/3186869717 shutdown_connections 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.990+0000 7f6442c39640 1 -- 172.21.15.28:0/3186869717 wait complete. 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 Processor -- start 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 -- start start 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c102a60 0x7f643c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c108cf0 0x7f643c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1129b0 con 0x7f643c1083a0 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.991+0000 7f6442c39640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f643c112830 con 0x7f643c102a60 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f6442c39640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f643c112b30 con 0x7f643c108cf0 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:52.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34906/0 (socket says 172.21.15.28:34906) 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 -- 172.21.15.28:0/4237628476 learned_addr learned my addr 172.21.15.28:0/4237628476 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f64409d5640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c102a60 0x7f643c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f64411d6640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c108cf0 0x7f643c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 -- 172.21.15.28:0/4237628476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c108cf0 msgr2=0x7f643c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c108cf0 0x7f643c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 -- 172.21.15.28:0/4237628476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c102a60 msgr2=0x7f643c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c102a60 0x7f643c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 -- 172.21.15.28:0/4237628476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c1a0300 con 0x7f643c1083a0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f643bfff640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f643000d770 tx=0x7f643000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430017070 con 0x7f643c1083a0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6430010460 con 0x7f643c1083a0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c1a05f0 con 0x7f643c1083a0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.992+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643000f620 con 0x7f643c1083a0 2024-09-21T07:05:52.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.993+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1a6e10 con 0x7f643c1083a0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.994+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c102e70 con 0x7f643c1083a0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.995+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f643001a070 con 0x7f643c1083a0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.996+0000 7f6439ffb640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 0x7f64240b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.996+0000 7f64409d5640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 0x7f64240b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.996+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f64300e6dc0 con 0x7f643c1083a0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.997+0000 7f64409d5640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 0x7f64240b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f642c00abe0 tx=0x7f642c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:52.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:51.999+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64300ad500 con 0x7f643c1083a0 2024-09-21T07:05:52.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.230+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f643c10baf0 con 0x7f643c1083a0 2024-09-21T07:05:52.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.231+0000 7f6439ffb640 1 -- 172.21.15.28:0/4237628476 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f64300b18e0 con 0x7f643c1083a0 2024-09-21T07:05:52.233 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:52.233 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:05:52.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 msgr2=0x7f64240b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 0x7f64240b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f642c00abe0 tx=0x7f642c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 msgr2=0x7f643c19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f643000d770 tx=0x7f643000db70 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 shutdown_connections 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f64240b65d0 0x7f64240b8ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f643c108cf0 0x7f643c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f643c1083a0 0x7f643c19a9f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 --2- 172.21.15.28:0/4237628476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f643c102a60 0x7f643c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 >> 172.21.15.28:0/4237628476 conn(0x7f643c079730 msgr2=0x7f643c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 shutdown_connections 2024-09-21T07:05:52.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:52.233+0000 7f6442c39640 1 -- 172.21.15.28:0/4237628476 wait complete. 2024-09-21T07:05:52.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:52 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4237628476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:05:52.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:52 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4237628476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:05:52.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:52 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4237628476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:05:52.937 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:05:52.938 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:05:53.197 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:53 smithi129 ceph-mon[34863]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:53.619 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:53 smithi028 ceph-mon[31213]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 -- 172.21.15.28:0/3137936840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff41083a0 msgr2=0x7f3ff41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 --2- 172.21.15.28:0/3137936840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff41083a0 0x7f3ff41087b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009900 tx=0x7f3fe802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 -- 172.21.15.28:0/3137936840 shutdown_connections 2024-09-21T07:05:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 --2- 172.21.15.28:0/3137936840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 0x7f3ff410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 --2- 172.21.15.28:0/3137936840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff41083a0 0x7f3ff41087b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 --2- 172.21.15.28:0/3137936840 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff4102a60 0x7f3ff4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 -- 172.21.15.28:0/3137936840 >> 172.21.15.28:0/3137936840 conn(0x7f3ff4079730 msgr2=0x7f3ff4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 -- 172.21.15.28:0/3137936840 shutdown_connections 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 -- 172.21.15.28:0/3137936840 wait complete. 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.711+0000 7f3ffa016640 1 Processor -- start 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 -- start start 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff41083a0 0x7f3ff4199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 0x7f3ff419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff4112960 con 0x7f3ff4102a60 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff41127e0 con 0x7f3ff41083a0 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ffa016640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff4112ae0 con 0x7f3ff4108cf0 2024-09-21T07:05:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33606/0 (socket says 172.21.15.28:33606) 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 -- 172.21.15.28:0/1464121272 learned_addr learned my addr 172.21.15.28:0/1464121272 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff3fff640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 0x7f3ff419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff2ffd640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff41083a0 0x7f3ff4199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 -- 172.21.15.28:0/1464121272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 msgr2=0x7f3ff419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 0x7f3ff419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 -- 172.21.15.28:0/1464121272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff41083a0 msgr2=0x7f3ff4199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff41083a0 0x7f3ff4199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.712+0000 7f3ff37fe640 1 -- 172.21.15.28:0/1464121272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff419f340 con 0x7f3ff4102a60 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ff37fe640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c890 tx=0x7f3fe400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004220 con 0x7f3ff4102a60 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe40043c0 con 0x7f3ff4102a60 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff419f630 con 0x7f3ff4102a60 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004a00 con 0x7f3ff4102a60 2024-09-21T07:05:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.713+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff41a5d90 con 0x7f3ff4102a60 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.714+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff4102e70 con 0x7f3ff4102a60 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.715+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3fe40079b0 con 0x7f3ff4102a60 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.716+0000 7f3ff0ff9640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 0x7f3fdc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.716+0000 7f3ff2ffd640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 0x7f3fdc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.716+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3fe40e7600 con 0x7f3ff4102a60 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.717+0000 7f3ff2ffd640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 0x7f3fdc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.719+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fe4014030 con 0x7f3ff4102a60 2024-09-21T07:05:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:53 smithi181 ceph-mon[34686]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.945+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ff419a500 con 0x7f3ff4102a60 2024-09-21T07:05:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.946+0000 7f3ff0ff9640 1 -- 172.21.15.28:0/1464121272 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7f3ff419a500 con 0x7f3ff4102a60 2024-09-21T07:05:53.949 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:53.949 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:05:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.948+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 msgr2=0x7f3fdc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 0x7f3fdc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8031400 comp rx=0 tx=0).stop 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 msgr2=0x7f3ff41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c890 tx=0x7f3fe400cd50 comp rx=0 tx=0).stop 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 shutdown_connections 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f3fdc0b65a0 0x7f3fdc0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff4108cf0 0x7f3ff419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ff41083a0 0x7f3ff4199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 --2- 172.21.15.28:0/1464121272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ff4102a60 0x7f3ff41993d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 >> 172.21.15.28:0/1464121272 conn(0x7f3ff4079730 msgr2=0x7f3ff41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 shutdown_connections 2024-09-21T07:05:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:53.949+0000 7f3ffa016640 1 -- 172.21.15.28:0/1464121272 wait complete. 2024-09-21T07:05:54.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:54 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1464121272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:54.641 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:54 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1464121272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:54.672 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:05:54.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:54 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1464121272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:54.933 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:55.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1230629098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d4076100 msgr2=0x7fb5d410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:55.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1230629098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d4076100 0x7fb5d410fb80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009900 tx=0x7fb5c402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:55.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1230629098 shutdown_connections 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1230629098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d41100c0 0x7fb5d4112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1230629098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d4076100 0x7fb5d410fb80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1230629098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d40757b0 0x7fb5d4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1230629098 >> 172.21.15.28:0/1230629098 conn(0x7fb5d407b850 msgr2=0x7fb5d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1230629098 shutdown_connections 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.428+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1230629098 wait complete. 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 Processor -- start 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 -- start start 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d4076100 0x7fb5d419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d41100c0 0x7fb5d41a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d4115c70 con 0x7fb5d40757b0 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d4115af0 con 0x7fb5d41100c0 2024-09-21T07:05:55.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dc5be640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d4115df0 con 0x7fb5d4076100 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33620/0 (socket says 172.21.15.28:33620) 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 -- 172.21.15.28:0/1734384819 learned_addr learned my addr 172.21.15.28:0/1734384819 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5d9b59640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d4076100 0x7fb5d419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5dab5b640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d41100c0 0x7fb5d41a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 -- 172.21.15.28:0/1734384819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d4076100 msgr2=0x7fb5d419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d4076100 0x7fb5d419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 -- 172.21.15.28:0/1734384819 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d41100c0 msgr2=0x7fb5d41a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d41100c0 0x7fb5d41a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.429+0000 7fb5da35a640 1 -- 172.21.15.28:0/1734384819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d41a2590 con 0x7fb5d40757b0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5da35a640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000d950 tx=0x7fb5d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0017030 con 0x7fb5d40757b0 2024-09-21T07:05:55.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5d0004020 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d41a2880 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00047a0 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.430+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d41a8fe0 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.431+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d4075bc0 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.433+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb5d0009a30 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.434+0000 7fb5cb7fe640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 0x7fb5c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.434+0000 7fb5d9b59640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 0x7fb5c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.434+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5d00e75c0 con 0x7fb5d40757b0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.434+0000 7fb5d9b59640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 0x7fb5c00b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000c00 tx=0x7fb5c4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:55.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.437+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5d00add00 con 0x7fb5d40757b0 2024-09-21T07:05:55.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:55 smithi129 ceph-mon[34863]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:55.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.666+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5d419d750 con 0x7fb5d40757b0 2024-09-21T07:05:55.669 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:55 smithi028 ceph-mon[31213]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:55.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.667+0000 7fb5cb7fe640 1 -- 172.21.15.28:0/1734384819 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7fb5d00b20e0 con 0x7fb5d40757b0 2024-09-21T07:05:55.670 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:55.670 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:05:55.670 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:05:55.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 msgr2=0x7fb5c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 0x7fb5c00b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000c00 tx=0x7fb5c4031400 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 msgr2=0x7fb5d419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000d950 tx=0x7fb5d000de10 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 shutdown_connections 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb5c00b65a0 0x7fb5c00b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5d41100c0 0x7fb5d41a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d4076100 0x7fb5d419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 --2- 172.21.15.28:0/1734384819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d40757b0 0x7fb5d419c620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:55.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 >> 172.21.15.28:0/1734384819 conn(0x7fb5d407b850 msgr2=0x7fb5d4101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:55.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 shutdown_connections 2024-09-21T07:05:55.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:55.670+0000 7fb5dc5be640 1 -- 172.21.15.28:0/1734384819 wait complete. 2024-09-21T07:05:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:55 smithi181 ceph-mon[34686]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:05:56.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:05:56.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:56 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1734384819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:56.626 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:56.743 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:56 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1734384819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:56.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:56 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1734384819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 -- 172.21.15.28:0/2697918453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d04105b10 msgr2=0x7f0d0410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 --2- 172.21.15.28:0/2697918453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d04105b10 0x7f0d0410f5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ca0 tx=0x7f0cfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 -- 172.21.15.28:0/2697918453 shutdown_connections 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 --2- 172.21.15.28:0/2697918453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d04105b10 0x7f0d0410f5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 --2- 172.21.15.28:0/2697918453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041051c0 0x7f0d041055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 --2- 172.21.15.28:0/2697918453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d041031b0 0x7f0d041035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 -- 172.21.15.28:0/2697918453 >> 172.21.15.28:0/2697918453 conn(0x7f0d04079e40 msgr2=0x7f0d0407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 -- 172.21.15.28:0/2697918453 shutdown_connections 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.119+0000 7f0d08920640 1 -- 172.21.15.28:0/2697918453 wait complete. 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 Processor -- start 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 -- start start 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 0x7f0d04199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 0x7f0d0419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:57.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d041129e0 con 0x7f0d041051c0 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0d04112860 con 0x7f0d04105b10 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d08920640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d04112b60 con 0x7f0d041031b0 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33642/0 (socket says 172.21.15.28:33642) 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 -- 172.21.15.28:0/765612501 learned_addr learned my addr 172.21.15.28:0/765612501 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d02d9d640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 0x7f0d0419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d0259c640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 0x7f0d04199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 -- 172.21.15.28:0/765612501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 msgr2=0x7f0d04199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 0x7f0d04199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 -- 172.21.15.28:0/765612501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 msgr2=0x7f0d0419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 0x7f0d0419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.120+0000 7f0d01d9b640 1 -- 172.21.15.28:0/765612501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0419f380 con 0x7f0d041051c0 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0d0259c640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 0x7f0d04199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0d02d9d640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 0x7f0d0419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0d01d9b640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d950 tx=0x7f0cf800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8017070 con 0x7f0d041051c0 2024-09-21T07:05:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0419f670 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cf8009c30 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80047a0 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.121+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d041a5dd0 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.122+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d041035c0 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.124+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0cf8004020 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.124+0000 7f0cf37fe640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 0x7f0cec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.124+0000 7f0d0259c640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 0x7f0cec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.124+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0cf80e74e0 con 0x7f0d041051c0 2024-09-21T07:05:57.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.125+0000 7f0d0259c640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 0x7f0cec0b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d0406bb50 tx=0x7f0cf4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:57.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.127+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cf8020020 con 0x7f0d041051c0 2024-09-21T07:05:57.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.315+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d0410a610 con 0x7f0d041051c0 2024-09-21T07:05:57.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.317+0000 7f0cf37fe640 1 -- 172.21.15.28:0/765612501 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7f0cf80adc20 con 0x7f0d041051c0 2024-09-21T07:05:57.319 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:57.319 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:05:57.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 msgr2=0x7f0cec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 0x7f0cec0b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d0406bb50 tx=0x7f0cf4005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 msgr2=0x7f0d041999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d950 tx=0x7f0cf800de10 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 shutdown_connections 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f0cec0b65a0 0x7f0cec0b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d04105b10 0x7f0d0419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d041051c0 0x7f0d041999b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 --2- 172.21.15.28:0/765612501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d041031b0 0x7f0d04199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 >> 172.21.15.28:0/765612501 conn(0x7f0d04079e40 msgr2=0x7f0d041063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 shutdown_connections 2024-09-21T07:05:57.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:57.319+0000 7f0d08920640 1 -- 172.21.15.28:0/765612501 wait complete. 2024-09-21T07:05:57.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:57 smithi129 ceph-mon[34863]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:57.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:57 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/765612501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:57.634 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:57 smithi028 ceph-mon[31213]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:57.634 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:57 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/765612501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:57 smithi181 ceph-mon[34686]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:05:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:57 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/765612501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:05:57.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:05:58.218 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 -- 172.21.15.28:0/3052187187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 msgr2=0x7f971c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 --2- 172.21.15.28:0/3052187187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c10f520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9714009900 tx=0x7f971402a410 comp rx=0 tx=0).stop 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 -- 172.21.15.28:0/3052187187 shutdown_connections 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 --2- 172.21.15.28:0/3052187187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c10f520 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 --2- 172.21.15.28:0/3052187187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c1083a0 0x7f971c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 --2- 172.21.15.28:0/3052187187 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c102a60 0x7f971c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 -- 172.21.15.28:0/3052187187 >> 172.21.15.28:0/3052187187 conn(0x7f971c079730 msgr2=0x7f971c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 -- 172.21.15.28:0/3052187187 shutdown_connections 2024-09-21T07:05:58.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.712+0000 7f9720b20640 1 -- 172.21.15.28:0/3052187187 wait complete. 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 Processor -- start 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 -- start start 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c102a60 0x7f971c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 0x7f971c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f971c112960 con 0x7f971c108cf0 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1127e0 con 0x7f971c1083a0 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9720b20640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f971c112ae0 con 0x7f971c102a60 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f971ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f971ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33664/0 (socket says 172.21.15.28:33664) 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f971ad9d640 1 -- 172.21.15.28:0/3913510467 learned_addr learned my addr 172.21.15.28:0/3913510467 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.713+0000 7f9719d9b640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 0x7f971c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:58.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971a59c640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c102a60 0x7f971c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 -- 172.21.15.28:0/3913510467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c102a60 msgr2=0x7f971c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c102a60 0x7f971c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 -- 172.21.15.28:0/3913510467 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 msgr2=0x7f971c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 0x7f971c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 -- 172.21.15.28:0/3913510467 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c1a0410 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f9719d9b640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 0x7f971c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f971ad9d640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9714004770 tx=0x7f9714004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971403f030 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9714004440 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714035070 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c1a06a0 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.714+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c1a6e60 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.715+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c103ce0 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.718+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9714042030 con 0x7f971c108cf0 2024-09-21T07:05:58.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.718+0000 7f970b7fe640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 0x7f97040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:58.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.719+0000 7f971a59c640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 0x7f97040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:58.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.719+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9714107a50 con 0x7f971c108cf0 2024-09-21T07:05:58.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.719+0000 7f971a59c640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 0x7f97040b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f970c005fd0 tx=0x7f970c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:58.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.722+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97140d2570 con 0x7f971c108cf0 2024-09-21T07:05:58.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.950+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f971c102e70 con 0x7f971c108cf0 2024-09-21T07:05:58.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.951+0000 7f970b7fe640 1 -- 172.21.15.28:0/3913510467 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7f971c102e70 con 0x7f971c108cf0 2024-09-21T07:05:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:05:58.953 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:05:58.954 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:05:58.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 msgr2=0x7f97040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 0x7f97040b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f970c005fd0 tx=0x7f970c009500 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 msgr2=0x7f971c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9714004770 tx=0x7f9714004040 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 shutdown_connections 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f97040b65a0 0x7f97040b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f971c108cf0 0x7f971c19fce0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f971c1083a0 0x7f971c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 --2- 172.21.15.28:0/3913510467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f971c102a60 0x7f971c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.953+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 >> 172.21.15.28:0/3913510467 conn(0x7f971c079730 msgr2=0x7f971c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.954+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 shutdown_connections 2024-09-21T07:05:58.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:05:58.954+0000 7f9720b20640 1 -- 172.21.15.28:0/3913510467 wait complete. 2024-09-21T07:05:59.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:59 smithi129 ceph-mon[34863]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:59.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:05:59 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3913510467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:59.643 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:59 smithi028 ceph-mon[31213]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:59.643 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:05:59 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3913510467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:59.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:04:40.762217+0000', 'modified': '2024-09-21T07:04:52.055120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24635, 'mds_1': 24623, 'mds_2': 24616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24589': {'gid': 24589, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1882677876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1882677876}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1882677876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/499879490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 499879490}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 499879490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.129:6837/2275077942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6836', 'nonce': 2275077942}, {'type': 'v1', 'addr': '172.21.15.129:6837', 'nonce': 2275077942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24616': {'gid': 24616, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6839/76790251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 76790251}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 76790251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.28:6841/1067476795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6840', 'nonce': 1067476795}, {'type': 'v1', 'addr': '172.21.15.28:6841', 'nonce': 1067476795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.129:6839/903226333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6838', 'nonce': 903226333}, {'type': 'v1', 'addr': '172.21.15.129:6839', 'nonce': 903226333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24635, 'qdb_cluster': [24616, 24623, 24635]} 2024-09-21T07:05:59.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T07:05:59.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:05:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:59 smithi181 ceph-mon[34686]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:05:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:05:59 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3913510467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:05:59.944 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 -- 172.21.15.28:0/313046283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc1094c0 msgr2=0x7f9dfc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 --2- 172.21.15.28:0/313046283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1098d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009900 tx=0x7f9dec02e820 comp rx=0 tx=0).stop 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 -- 172.21.15.28:0/313046283 shutdown_connections 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 --2- 172.21.15.28:0/313046283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc109e10 0x7f9dfc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 --2- 172.21.15.28:0/313046283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1098d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.480+0000 7f9e0344a640 1 --2- 172.21.15.28:0/313046283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.481+0000 7f9e0344a640 1 -- 172.21.15.28:0/313046283 >> 172.21.15.28:0/313046283 conn(0x7f9dfc077bc0 msgr2=0x7f9dfc078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.481+0000 7f9e0344a640 1 -- 172.21.15.28:0/313046283 shutdown_connections 2024-09-21T07:06:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.481+0000 7f9e0344a640 1 -- 172.21.15.28:0/313046283 wait complete. 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.481+0000 7f9e0344a640 1 Processor -- start 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 -- start start 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 0x7f9dfc1a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc111890 con 0x7f9dfc101fe0 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc111710 con 0x7f9dfc109e10 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e0344a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc111a10 con 0x7f9dfc1094c0 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33690/0 (socket says 172.21.15.28:33690) 2024-09-21T07:06:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 -- 172.21.15.28:0/2039461029 learned_addr learned my addr 172.21.15.28:0/2039461029 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e009e5640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e019e7640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 0x7f9dfc1a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 -- 172.21.15.28:0/2039461029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 msgr2=0x7f9dfc1a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 -- 172.21.15.28:0/2039461029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 msgr2=0x7f9dfc1a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 0x7f9dfc1a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e011e6640 1 -- 172.21.15.28:0/2039461029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc1a6aa0 con 0x7f9dfc101fe0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e019e7640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 0x7f9dfc1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.482+0000 7f9e009e5640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9e011e6640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d950 tx=0x7f9df800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9df27fc640 1 -- 172.21.15.28:0/2039461029 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8017030 con 0x7f9dfc101fe0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc1a6d90 con 0x7f9dfc101fe0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9df27fc640 1 -- 172.21.15.28:0/2039461029 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9df8004020 con 0x7f9dfc101fe0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9df27fc640 1 -- 172.21.15.28:0/2039461029 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80047a0 con 0x7f9dfc101fe0 2024-09-21T07:06:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.483+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1ad4f0 con 0x7f9dfc101fe0 2024-09-21T07:06:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 Processor -- start 2024-09-21T07:06:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 -- start start 2024-09-21T07:06:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9df27fc640 1 -- 172.21.15.28:0/2039461029 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9df8009a30 con 0x7f9dfc101fe0 2024-09-21T07:06:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc74bf60 0x55f8ccaf1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc72b280 0x55f8ccaf2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8cca69c10 con 0x55f8cc72b280 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f8cca59040 con 0x55f8cc74bf60 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e099be740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f8cca5ce50 con 0x55f8cc7230a0 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.28:50554/0 (socket says 172.21.15.28:50554) 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e011e6640 1 -- 172.21.15.28:0/351829723 learned_addr learned my addr 172.21.15.28:0/351829723 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e019e7640 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc74bf60 0x55f8ccaf1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.486+0000 7f9e009e5640 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc72b280 0x55f8ccaf2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 -- 172.21.15.28:0/351829723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc74bf60 msgr2=0x55f8ccaf1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc74bf60 0x55f8ccaf1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 -- 172.21.15.28:0/351829723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc72b280 msgr2=0x55f8ccaf2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc72b280 0x55f8ccaf2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 -- 172.21.15.28:0/351829723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cc7b7540 con 0x55f8cc7230a0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9df27fc640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 0x7f9de80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e011e6640 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9df80eae20 tx=0x7f9df80ef4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba156684bde47f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9e019e7640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 0x7f9de80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9de77fe640 1 -- 172.21.15.28:0/351829723 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80a9580 con 0x55f8cc7230a0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9df27fc640 1 -- 172.21.15.28:0/2039461029 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9df80e6f50 con 0x7f9dfc101fe0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9de77fe640 1 -- 172.21.15.28:0/351829723 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9df80aca40 con 0x55f8cc7230a0 2024-09-21T07:06:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.487+0000 7f9de77fe640 1 -- 172.21.15.28:0/351829723 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80dfba0 con 0x55f8cc7230a0 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 -- 172.21.15.28:0/351829723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 msgr2=0x55f8ccaf2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e019e7640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 0x7f9de80b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9df4005fd0 tx=0x7f9df4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9df80eae20 tx=0x7f9df80ef4b0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 -- 172.21.15.28:0/351829723 shutdown_connections 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc72b280 0x55f8ccaf2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc7230a0 0x55f8ccaf2440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 --2- 172.21.15.28:0/351829723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc74bf60 0x55f8ccaf1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 -- 172.21.15.28:0/351829723 >> 172.21.15.28:0/351829723 conn(0x55f8cc740350 msgr2=0x55f8ccaefdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 -- 172.21.15.28:0/351829723 shutdown_connections 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.488+0000 7f9e099be740 1 -- 172.21.15.28:0/351829723 wait complete. 2024-09-21T07:06:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 -- start start 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 Processor -- start 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccafd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccafdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8cc8ba5f0 con 0x55f8cc74bf60 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f8cc9f4010 con 0x55f8cc7230a0 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb006e0 con 0x55f8cc72b280 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.489+0000 7f9e099be740 10 client.0 _ll_register_callbacks cb 0x55f8cca53340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33720/0 (socket says 172.21.15.28:33720) 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 -- 172.21.15.28:0/3607351523 learned_addr learned my addr 172.21.15.28:0/3607351523 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e009e5640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccafdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e011e6640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccafd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 -- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 msgr2=0x55f8ccafdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccafdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 -- 172.21.15.28:0/3607351523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 msgr2=0x55f8ccafd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccafd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 -- 172.21.15.28:0/3607351523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cca21a00 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9e019e7640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9df4012010 tx=0x7f9df4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8075a578d5b0cda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9de4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df402c060 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.490+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9df4017030 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9df80aca40 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9df401fc80 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 10 client.15162 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f8ccb0c660 con 0x55f8cc74bf60 2024-09-21T07:06:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9df80aca40 con 0x55f8cc74bf60 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9df401c3f0 con 0x55f8cc74bf60 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 10 client.15162 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 10 client.15162 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 20 client.15162 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc70a8e0 0x55f8ccb10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 4 client.15162 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.491+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 --> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8cca6bb60 con 0x55f8cc70a8e0 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.492+0000 7f9e011e6640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc70a8e0 0x55f8ccb10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.492+0000 7f9de4ff9640 10 client.15162 ms_handle_connect on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.492+0000 7f9e011e6640 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc70a8e0 0x55f8ccb10140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf51f67abed501fe server_cookie=5df3e6b3778ff15b in_seq=0 out_seq=0 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9de4ff9640 1 -- 172.21.15.28:0/3607351523 <== mds.2 v2:172.21.15.181:6838/76790251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8cca6bb60 con 0x55f8cc70a8e0 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9de4ff9640 10 client.15162 handle_command_reply: tid=0 2024-09-21T07:06:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 client.15162 shutdown 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 msgr2=0x55f8ccb09a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9df4012010 tx=0x7f9df4004ab0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 shutdown_connections 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc70a8e0 0x55f8ccb10140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc74bf60 0x55f8ccb09a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9de4ff9640 0 client.15162 ms_handle_reset on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccafdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 --2- 172.21.15.28:0/3607351523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccafd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 >> 172.21.15.28:0/3607351523 conn(0x55f8cc740350 msgr2=0x55f8ccaf5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 shutdown_connections 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 1 -- 172.21.15.28:0/3607351523 wait complete. 2024-09-21T07:06:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.493+0000 7f9e099be740 20 client.15162 trim_cache size 0 max 16384 2024-09-21T07:06:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 Processor -- start 2024-09-21T07:06:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 -- start start 2024-09-21T07:06:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb09970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc72b280 0x55f8ccaef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb0e480 con 0x55f8cc7230a0 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb0eb50 con 0x55f8cc72b280 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e099be740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb0f220 con 0x55f8cc70a8e0 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e009e5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e009e5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33728/0 (socket says 172.21.15.28:33728) 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.512+0000 7f9e009e5640 1 -- 172.21.15.28:0/1189535338 learned_addr learned my addr 172.21.15.28:0/1189535338 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e011e6640 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb09970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e019e7640 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc72b280 0x55f8ccaef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 -- 172.21.15.28:0/1189535338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc70a8e0 msgr2=0x55f8ccb09970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb09970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 -- 172.21.15.28:0/1189535338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc72b280 msgr2=0x55f8ccaef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc72b280 0x55f8ccaef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 -- 172.21.15.28:0/1189535338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ccb00070 con 0x55f8cc7230a0 2024-09-21T07:06:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ea36830f9b1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9de6ffd640 1 -- 172.21.15.28:0/1189535338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec036550 con 0x55f8cc7230a0 2024-09-21T07:06:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9de6ffd640 1 -- 172.21.15.28:0/1189535338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dec0366f0 con 0x55f8cc7230a0 2024-09-21T07:06:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.513+0000 7f9de6ffd640 1 -- 172.21.15.28:0/1189535338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec004750 con 0x55f8cc7230a0 2024-09-21T07:06:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- 172.21.15.28:0/1189535338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 msgr2=0x55f8ccb09eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec005e50 comp rx=0 tx=0).stop 2024-09-21T07:06:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- 172.21.15.28:0/1189535338 shutdown_connections 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc72b280 0x55f8ccaef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc7230a0 0x55f8ccb09eb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189535338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb09970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- 172.21.15.28:0/1189535338 >> 172.21.15.28:0/1189535338 conn(0x55f8cc740350 msgr2=0x55f8ccafc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- 172.21.15.28:0/1189535338 shutdown_connections 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- 172.21.15.28:0/1189535338 wait complete. 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.514+0000 7f9e099be740 1 -- start start 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 Processor -- start 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccb12b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccb13080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb0ffc0 con 0x55f8cc70a8e0 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb0f8f0 con 0x55f8cc7230a0 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f8ccb10690 con 0x55f8cc72b280 2024-09-21T07:06:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e099be740 10 client.0 _ll_register_callbacks cb 0x7f9df4009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33730/0 (socket says 172.21.15.28:33730) 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 -- 172.21.15.28:0/1189364799 learned_addr learned my addr 172.21.15.28:0/1189364799 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e019e7640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccb13080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccb12b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 -- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 msgr2=0x55f8ccb13080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccb13080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 -- 172.21.15.28:0/1189364799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 msgr2=0x55f8ccb12b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.515+0000 7f9e011e6640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccb12b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e011e6640 1 -- 172.21.15.28:0/1189364799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ccb17f40 con 0x55f8cc70a8e0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e011e6640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9df80aa1a0 tx=0x7f9df8094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853862155c7f6d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80dcb30 con 0x55f8cc70a8e0 2024-09-21T07:06:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9df80e4b00 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dec0366f0 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9df80dcd00 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e099be740 10 client.15168 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f8ccb7ba80 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dec0366f0 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9df805c180 con 0x55f8cc70a8e0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.516+0000 7f9e099be740 10 client.15168 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 20 client.15168 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc74bf60 0x55f8ccb7eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 4 client.15168 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 --> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] -- command(tid 0: {"prefix": "status"}) -- 0x55f8cca67610 con 0x55f8cc74bf60 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc74bf60 0x55f8ccb7eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e009e5640 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc74bf60 0x55f8ccb7eef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef7fe890aefef312 server_cookie=2092774b5d628163 in_seq=0 out_seq=0 2024-09-21T07:06:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9de4ff9640 10 client.15168 ms_handle_connect on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9de4ff9640 1 -- 172.21.15.28:0/1189364799 <== mds.2 v2:172.21.15.181:6838/76790251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f8cca67610 con 0x55f8cc74bf60 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9de4ff9640 10 client.15168 handle_command_reply: tid=0 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 1 client.15168 shutdown 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 msgr2=0x55f8ccb12600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.517+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9df80aa1a0 tx=0x7f9df8094040 comp rx=0 tx=0).stop 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 shutdown_connections 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x55f8cc74bf60 0x55f8ccb7eef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8cc72b280 0x55f8ccb13080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f8cc7230a0 0x55f8ccb12b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 --2- 172.21.15.28:0/1189364799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f8cc70a8e0 0x55f8ccb12600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9de4ff9640 0 client.15168 ms_handle_reset on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 >> 172.21.15.28:0/1189364799 conn(0x55f8cc740350 msgr2=0x55f8ccaee3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 shutdown_connections 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 1 -- 172.21.15.28:0/1189364799 wait complete. 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e099be740 20 client.15168 trim_cache size 0 max 16384 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24616, 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 71.177064630000004, 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 99.515185867 2024-09-21T07:06:00.526 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 msgr2=0x7f9de80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 0x7f9de80b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9df4005fd0 tx=0x7f9df4009500 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 msgr2=0x7f9dfc1a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d950 tx=0x7f9df800de10 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 shutdown_connections 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.518+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9de80b6620 0x7f9de80b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9dfc109e10 0x7f9dfc1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1094c0 0x7f9dfc1a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 --2- 172.21.15.28:0/2039461029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dfc101fe0 0x7f9dfc1a0b30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 >> 172.21.15.28:0/2039461029 conn(0x7f9dfc077bc0 msgr2=0x7f9dfc107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 shutdown_connections 2024-09-21T07:06:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:00.519+0000 7f9e0344a640 1 -- 172.21.15.28:0/2039461029 wait complete. 2024-09-21T07:06:01.182 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.a status 2024-09-21T07:06:01.439 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:01.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:01 smithi129 ceph-mon[34863]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:01.704 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:01 smithi028 ceph-mon[31213]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:01 smithi181 ceph-mon[34686]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:01.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4113082705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea4109df0 msgr2=0x7f9ea4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4113082705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea4109df0 0x7f9ea4110620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009ca0 tx=0x7f9e9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4113082705 shutdown_connections 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4113082705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea4109df0 0x7f9ea4110620 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4113082705 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea41094a0 0x7f9ea41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4113082705 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 0x7f9ea4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4113082705 >> 172.21.15.28:0/4113082705 conn(0x7f9ea407b850 msgr2=0x7f9ea407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4113082705 shutdown_connections 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4113082705 wait complete. 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 Processor -- start 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.931+0000 7f9eabd6e640 1 -- start start 2024-09-21T07:06:01.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 0x7f9ea419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 0x7f9ea419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4113ab0 con 0x7f9ea41094a0 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4113930 con 0x7f9ea4109df0 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eabd6e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4113c30 con 0x7f9ea4103b60 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33744/0 (socket says 172.21.15.28:33744) 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 -- 172.21.15.28:0/4231166814 learned_addr learned my addr 172.21.15.28:0/4231166814 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 0x7f9ea419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 0x7f9ea419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 -- 172.21.15.28:0/4231166814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 msgr2=0x7f9ea419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 0x7f9ea419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 -- 172.21.15.28:0/4231166814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 msgr2=0x7f9ea419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 0x7f9ea419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 -- 172.21.15.28:0/4231166814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea41a0390 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 0x7f9ea419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.932+0000 7f9ea9309640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400e9f0 tx=0x7f9e9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.933+0000 7f9e9affd640 1 -- 172.21.15.28:0/4231166814 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400ccc0 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.933+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea41a0680 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.933+0000 7f9e9affd640 1 -- 172.21.15.28:0/4231166814 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e940108e0 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.933+0000 7f9e9affd640 1 -- 172.21.15.28:0/4231166814 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94018860 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.933+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea41a6de0 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.935+0000 7f9eb22e2740 1 Processor -- start 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.935+0000 7f9eb22e2740 1 -- start start 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.935+0000 7f9e9affd640 1 -- 172.21.15.28:0/4231166814 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e94010430 con 0x7f9ea41094a0 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2d9f60 0x564b8d67ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2b9280 0x564b8d680980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564b8d5f7c10 con 0x564b8d2b9280 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b8d5e7040 con 0x564b8d2d9f60 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b8d5eae50 con 0x564b8d2b10a0 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9309640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2b9280 0x564b8d680980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.28:50608/0 (socket says 172.21.15.28:50608) 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 -- 172.21.15.28:0/1472052648 learned_addr learned my addr 172.21.15.28:0/1472052648 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:01.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2d9f60 0x564b8d67ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 -- 172.21.15.28:0/1472052648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2d9f60 msgr2=0x564b8d67ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2d9f60 0x564b8d67ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 -- 172.21.15.28:0/1472052648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2b9280 msgr2=0x564b8d680980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2b9280 0x564b8d680980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.936+0000 7f9ea9b0a640 1 -- 172.21.15.28:0/1472052648 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8d345540 con 0x564b8d2b10a0 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9e9affd640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 0x7f9e900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b760 tx=0x7f9ea000bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d6078081b5a51d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 0x7f9e900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9e8ffff640 1 -- 172.21.15.28:0/1472052648 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0003d70 con 0x564b8d2b10a0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9e9affd640 1 -- 172.21.15.28:0/4231166814 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e940e77c0 con 0x7f9ea41094a0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9e8ffff640 1 -- 172.21.15.28:0/1472052648 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ea0015070 con 0x564b8d2b10a0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.937+0000 7f9e8ffff640 1 -- 172.21.15.28:0/1472052648 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0004d00 con 0x564b8d2b10a0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1472052648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 msgr2=0x564b8d680440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 0x7f9e900b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c004af0 tx=0x7f9e9c005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b760 tx=0x7f9ea000bc20 comp rx=0 tx=0).stop 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1472052648 shutdown_connections 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2b9280 0x564b8d680980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d680440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1472052648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2d9f60 0x564b8d67ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1472052648 >> 172.21.15.28:0/1472052648 conn(0x564b8d2ce350 msgr2=0x564b8d67ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1472052648 shutdown_connections 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1472052648 wait complete. 2024-09-21T07:06:01.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 -- start start 2024-09-21T07:06:01.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.938+0000 7f9eb22e2740 1 Processor -- start 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564b8d4485f0 con 0x564b8d2d9f60 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b8d582010 con 0x564b8d2b9280 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b8d692a40 con 0x564b8d2b10a0 2024-09-21T07:06:01.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eb22e2740 10 client.0 _ll_register_callbacks cb 0x564b8d5e1340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33764/0 (socket says 172.21.15.28:33764) 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1817758801 learned_addr learned my addr 172.21.15.28:0/1817758801 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9ea9309640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1817758801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 msgr2=0x564b8d68fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1817758801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 msgr2=0x564b8d690340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.939+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1817758801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8d5afa00 con 0x564b8d2d9f60 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009ca0 tx=0x7f9e9c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f48ecb91c6d754 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9e8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c003c40 con 0x564b8d2d9f60 2024-09-21T07:06:01.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e9c003de0 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea0015070 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e9c004040 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9eb22e2740 10 client.15180 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564b8d69e9d0 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.940+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ea0015070 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e9c051070 con 0x564b8d2d9f60 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 10 client.15180 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 10 client.15180 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 20 client.15180 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d2988e0 0x564b8d6a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 4 client.15180 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 --> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b8d5f9b60 con 0x564b8d2988e0 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d2988e0 0x564b8d6a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9e8d7fa640 10 client.15180 ms_handle_connect on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.941+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d2988e0 0x564b8d6a2560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23fcbc713b7cf3e0 server_cookie=6c74bf9717ceb3a in_seq=0 out_seq=0 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1817758801 <== mds.1 v2:172.21.15.28:6840/1067476795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b8d5f9b60 con 0x564b8d2988e0 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9e8d7fa640 10 client.15180 handle_command_reply: tid=0 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 client.15180 shutdown 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 msgr2=0x564b8d69bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009ca0 tx=0x7f9e9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 shutdown_connections 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d2988e0 0x564b8d6a2560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69bda0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1817758801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9e8d7fa640 0 client.15180 ms_handle_reset on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 >> 172.21.15.28:0/1817758801 conn(0x564b8d2ce350 msgr2=0x564b8d6818f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.942+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 shutdown_connections 2024-09-21T07:06:01.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.943+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1817758801 wait complete. 2024-09-21T07:06:01.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.943+0000 7f9eb22e2740 20 client.15180 trim_cache size 0 max 16384 2024-09-21T07:06:01.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 Processor -- start 2024-09-21T07:06:01.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 -- start start 2024-09-21T07:06:01.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a08a0 con 0x564b8d2d9f60 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a0f70 con 0x564b8d2b10a0 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a1640 con 0x564b8d2b9280 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33772/0 (socket says 172.21.15.28:33772) 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.961+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1555713778 learned_addr learned my addr 172.21.15.28:0/1555713778 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9ea9309640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1555713778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b9280 msgr2=0x564b8d690340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1555713778 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 msgr2=0x564b8d68fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1555713778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8d690ec0 con 0x564b8d2d9f60 2024-09-21T07:06:01.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:01.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005cc0 tx=0x7f9e9c031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b64c12f7a17b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9e8f7fe640 1 -- 172.21.15.28:0/1555713778 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c062070 con 0x564b8d2d9f60 2024-09-21T07:06:01.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9e8f7fe640 1 -- 172.21.15.28:0/1555713778 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e9c059030 con 0x564b8d2d9f60 2024-09-21T07:06:01.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.962+0000 7f9e8f7fe640 1 -- 172.21.15.28:0/1555713778 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004440 con 0x564b8d2d9f60 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1555713778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 msgr2=0x564b8d69fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005cc0 tx=0x7f9e9c031820 comp rx=0 tx=0).stop 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1555713778 shutdown_connections 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d69fd20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b9280 0x564b8d690340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1555713778 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b10a0 0x564b8d68fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1555713778 >> 172.21.15.28:0/1555713778 conn(0x564b8d2ce350 msgr2=0x564b8d678ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1555713778 shutdown_connections 2024-09-21T07:06:01.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.963+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1555713778 wait complete. 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 -- start start 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 Processor -- start 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d6a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d6a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a23e0 con 0x564b8d2d9f60 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a1d10 con 0x564b8d2b9280 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b8d6a2ab0 con 0x564b8d2b10a0 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.964+0000 7f9eb22e2740 10 client.0 _ll_register_callbacks cb 0x7f9e9c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33778/0 (socket says 172.21.15.28:33778) 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1960414576 learned_addr learned my addr 172.21.15.28:0/1960414576 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9ea9309640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d6a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d6a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1960414576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 msgr2=0x564b8d6a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d6a4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1960414576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 msgr2=0x564b8d6a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d6a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 -- 172.21.15.28:0/1960414576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8d6aa3d0 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d6a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eaa30b640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c02fce0 tx=0x7f9e9c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d250064de5345 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9e8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c062040 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e9c003e40 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.965+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e9c059030 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e9c004b40 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 10 client.15186 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564b8d6ab5c0 con 0x564b8d2d9f60 2024-09-21T07:06:01.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e9c059030 con 0x564b8d2d9f60 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e9c051040 con 0x564b8d2d9f60 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 10 client.15186 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 10 client.15186 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 20 client.15186 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d26dc90 0x564b8d710cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 4 client.15186 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 --> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] -- command(tid 0: {"prefix": "status"}) -- 0x564b8d5f5610 con 0x564b8d26dc90 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.966+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d26dc90 0x564b8d710cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9ea9b0a640 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d26dc90 0x564b8d710cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=608785e2c0b1463b server_cookie=fad091f3bafddff1 in_seq=0 out_seq=0 2024-09-21T07:06:01.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9e8d7fa640 10 client.15186 ms_handle_connect on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:01.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9e8d7fa640 1 -- 172.21.15.28:0/1960414576 <== mds.1 v2:172.21.15.28:6840/1067476795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564b8d5f5610 con 0x564b8d26dc90 2024-09-21T07:06:01.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9e8d7fa640 10 client.15186 handle_command_reply: tid=0 2024-09-21T07:06:01.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 client.15186 shutdown 2024-09-21T07:06:01.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 msgr2=0x564b8d6a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c02fce0 tx=0x7f9e9c0095c0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 shutdown_connections 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564b8d26dc90 0x564b8d710cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b8d2d9f60 0x564b8d6a9d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b8d2b9280 0x564b8d6a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 --2- 172.21.15.28:0/1960414576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b8d2b10a0 0x564b8d6a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9e8d7fa640 0 client.15186 ms_handle_reset on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.967+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 >> 172.21.15.28:0/1960414576 conn(0x564b8d2ce350 msgr2=0x564b8d68fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 shutdown_connections 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eb22e2740 1 -- 172.21.15.28:0/1960414576 wait complete. 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eb22e2740 20 client.15186 trim_cache size 0 max 16384 2024-09-21T07:06:01.974 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24623, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 73.632998294000004, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 94.761944791000005 2024-09-21T07:06:01.975 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:01.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 msgr2=0x7f9e900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 0x7f9e900b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c004af0 tx=0x7f9e9c005c30 comp rx=0 tx=0).stop 2024-09-21T07:06:01.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 msgr2=0x7f9ea419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:01.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.968+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400e9f0 tx=0x7f9e9400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 shutdown_connections 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f9e900b65a0 0x7f9e900b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ea4109df0 0x7f9ea419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea41094a0 0x7f9ea419a9c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 --2- 172.21.15.28:0/4231166814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ea4103b60 0x7f9ea419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 >> 172.21.15.28:0/4231166814 conn(0x7f9ea407b850 msgr2=0x7f9ea4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:01.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 shutdown_connections 2024-09-21T07:06:01.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:01.969+0000 7f9eabd6e640 1 -- 172.21.15.28:0/4231166814 wait complete. 2024-09-21T07:06:02.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:06:02.942 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:03.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 -- 172.21.15.28:0/3333971048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 msgr2=0x7f98981098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 --2- 172.21.15.28:0/3333971048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f98981098b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f988c009900 tx=0x7f988c02a410 comp rx=0 tx=0).stop 2024-09-21T07:06:03.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 -- 172.21.15.28:0/3333971048 shutdown_connections 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 --2- 172.21.15.28:0/3333971048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898109df0 0x7f9898110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 --2- 172.21.15.28:0/3333971048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f98981098b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 --2- 172.21.15.28:0/3333971048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898103b60 0x7f9898103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 -- 172.21.15.28:0/3333971048 >> 172.21.15.28:0/3333971048 conn(0x7f989807b850 msgr2=0x7f989807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 -- 172.21.15.28:0/3333971048 shutdown_connections 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.449+0000 7f989df41640 1 -- 172.21.15.28:0/3333971048 wait complete. 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 Processor -- start 2024-09-21T07:06:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 -- start start 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898103b60 0x7f989810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 0x7f98981a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f98980768f0 con 0x7f98981094a0 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9898076770 con 0x7f9898109df0 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f989df41640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9898076a70 con 0x7f9898103b60 2024-09-21T07:06:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48024/0 (socket says 172.21.15.28:48024) 2024-09-21T07:06:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f9896ffd640 1 -- 172.21.15.28:0/4059885055 learned_addr learned my addr 172.21.15.28:0/4059885055 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f98977fe640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898103b60 0x7f989810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.450+0000 7f9897fff640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 0x7f98981a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 -- 172.21.15.28:0/4059885055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898103b60 msgr2=0x7f989810d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898103b60 0x7f989810d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 -- 172.21.15.28:0/4059885055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 msgr2=0x7f98981a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 0x7f98981a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 -- 172.21.15.28:0/4059885055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98981a6910 con 0x7f98981094a0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9897fff640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 0x7f98981a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9896ffd640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f988c02a930 tx=0x7f988c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9894ff9640 1 -- 172.21.15.28:0/4059885055 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c03f030 con 0x7f98981094a0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98981a6ba0 con 0x7f98981094a0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9894ff9640 1 -- 172.21.15.28:0/4059885055 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c003aa0 con 0x7f98981094a0 2024-09-21T07:06:03.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f9894ff9640 1 -- 172.21.15.28:0/4059885055 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c035070 con 0x7f98981094a0 2024-09-21T07:06:03.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.451+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98981a7080 con 0x7f98981094a0 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 Processor -- start 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f9894ff9640 1 -- 172.21.15.28:0/4059885055 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f988c042030 con 0x7f98981094a0 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 -- start start 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd010f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd011440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55bafcf88c10 con 0x55bafcc4a280 2024-09-21T07:06:03.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55bafcf78040 con 0x55bafcc420a0 2024-09-21T07:06:03.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98a44b5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bafcf7be50 con 0x55bafcc6af60 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48038/0 (socket says 172.21.15.28:48038) 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f9896ffd640 1 -- 172.21.15.28:0/3236413723 learned_addr learned my addr 172.21.15.28:0/3236413723 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f9897fff640 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd010f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.455+0000 7f98977fe640 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd011440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 -- 172.21.15.28:0/3236413723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 msgr2=0x55bafd010f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd010f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 -- 172.21.15.28:0/3236413723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 msgr2=0x55bafd011440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd011440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 -- 172.21.15.28:0/3236413723 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bafccd6540 con 0x55bafcc4a280 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9894ff9640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 0x7f98800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f988c105450 tx=0x7f988c10be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9302dbd775553522 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9897fff640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 0x7f98800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f9894ff9640 1 -- 172.21.15.28:0/4059885055 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f988c107b50 con 0x7f98981094a0 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f987dffb640 1 -- 172.21.15.28:0/3236413723 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0ca1e0 con 0x55bafcc4a280 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f987dffb640 1 -- 172.21.15.28:0/3236413723 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c0c92f0 con 0x55bafcc4a280 2024-09-21T07:06:03.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.456+0000 7f987dffb640 1 -- 172.21.15.28:0/3236413723 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0cd300 con 0x55bafcc4a280 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 -- 172.21.15.28:0/3236413723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 msgr2=0x55bafd011980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f988c105450 tx=0x7f988c10be20 comp rx=0 tx=0).stop 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f9897fff640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 0x7f98800b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9890005fd0 tx=0x7f9890009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 -- 172.21.15.28:0/3236413723 shutdown_connections 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd011980 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd011440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3236413723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd010f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 -- 172.21.15.28:0/3236413723 >> 172.21.15.28:0/3236413723 conn(0x55bafcc5f350 msgr2=0x55bafd00edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 -- 172.21.15.28:0/3236413723 shutdown_connections 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.457+0000 7f98a44b5740 1 -- 172.21.15.28:0/3236413723 wait complete. 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 -- start start 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 Processor -- start 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd01ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd028700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55bafcdd95f0 con 0x55bafcc4a280 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55bafcf13010 con 0x55bafcc420a0 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bafd01f4a0 con 0x55bafcc6af60 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f98a44b5740 10 client.0 _ll_register_callbacks cb 0x55bafcf72340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48052/0 (socket says 172.21.15.28:48052) 2024-09-21T07:06:03.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.458+0000 7f9896ffd640 1 -- 172.21.15.28:0/3462137651 learned_addr learned my addr 172.21.15.28:0/3462137651 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f98977fe640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd01ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9897fff640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd028700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 -- 172.21.15.28:0/3462137651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 msgr2=0x55bafd028700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd028700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 -- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 msgr2=0x55bafd01ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd01ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 -- 172.21.15.28:0/3462137651 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bafcf40a00 con 0x55bafcc4a280 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9897fff640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd028700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9896ffd640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f988c0cae00 tx=0x7f988c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c0989601fc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c049070 con 0x55bafcc4a280 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f988c0f10c0 con 0x55bafcc4a280 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c0c92f0 con 0x55bafcc4a280 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f988c0cd4e0 con 0x55bafcc4a280 2024-09-21T07:06:03.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f98a44b5740 10 client.15198 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.459+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bafd02b3a0 con 0x55bafcc4a280 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c0c92f0 con 0x55bafcc4a280 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f988c0d7120 con 0x55bafcc4a280 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 10 client.15198 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 20 client.15198 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc298e0 0x55bafd02eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 4 client.15198 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 --> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bafcf8ab60 con 0x55bafcc298e0 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.460+0000 7f98977fe640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc298e0 0x55bafd02eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.461+0000 7f9876ffd640 10 client.15198 ms_handle_connect on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:03.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.461+0000 7f98977fe640 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc298e0 0x55bafd02eb60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a7f0963eac0903 server_cookie=338dc8c874bb5ba3 in_seq=0 out_seq=0 2024-09-21T07:06:03.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f9876ffd640 1 -- 172.21.15.28:0/3462137651 <== mds.0 v2:172.21.15.129:6838/903226333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bafcf8ab60 con 0x55bafcc298e0 2024-09-21T07:06:03.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f9876ffd640 10 client.15198 handle_command_reply: tid=0 2024-09-21T07:06:03.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 client.15198 shutdown 2024-09-21T07:06:03.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 msgr2=0x55bafd01cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f988c0cae00 tx=0x7f988c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 shutdown_connections 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc6af60 0x55bafd028700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc298e0 0x55bafd02eb60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f9876ffd640 0 client.15198 ms_handle_reset on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd01cf70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 --2- 172.21.15.28:0/3462137651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc420a0 0x55bafd01ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 >> 172.21.15.28:0/3462137651 conn(0x55bafcc5f350 msgr2=0x55bafd014090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 shutdown_connections 2024-09-21T07:06:03.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 1 -- 172.21.15.28:0/3462137651 wait complete. 2024-09-21T07:06:03.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.462+0000 7f98a44b5740 20 client.15198 trim_cache size 0 max 16384 2024-09-21T07:06:03.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 Processor -- start 2024-09-21T07:06:03.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 -- start start 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc298e0 0x55bafd017020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 0x55bafd00dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02cea0 con 0x55bafcc4a280 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02d570 con 0x55bafcc298e0 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98a44b5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02dc40 con 0x55bafcc420a0 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48054/0 (socket says 172.21.15.28:48054) 2024-09-21T07:06:03.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 -- 172.21.15.28:0/2148760402 learned_addr learned my addr 172.21.15.28:0/2148760402 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f98977fe640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc298e0 0x55bafd017020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9896ffd640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 0x55bafd00dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 -- 172.21.15.28:0/2148760402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 msgr2=0x55bafd00dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 0x55bafd00dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 -- 172.21.15.28:0/2148760402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc298e0 msgr2=0x55bafd017020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc298e0 0x55bafd017020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9897fff640 1 -- 172.21.15.28:0/2148760402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bafd009080 con 0x55bafcc4a280 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.481+0000 7f9896ffd640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 0x55bafd00dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.482+0000 7f9897fff640 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9890009720 tx=0x7f9890016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c02fd7040a9719 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.482+0000 7f987d7fa640 1 -- 172.21.15.28:0/2148760402 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890029440 con 0x55bafcc4a280 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.482+0000 7f987d7fa640 1 -- 172.21.15.28:0/2148760402 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f989001f8c0 con 0x55bafcc4a280 2024-09-21T07:06:03.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.482+0000 7f987d7fa640 1 -- 172.21.15.28:0/2148760402 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890028990 con 0x55bafcc4a280 2024-09-21T07:06:03.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- 172.21.15.28:0/2148760402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 msgr2=0x55bafd028400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9890009720 tx=0x7f9890016000 comp rx=0 tx=0).stop 2024-09-21T07:06:03.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- 172.21.15.28:0/2148760402 shutdown_connections 2024-09-21T07:06:03.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc4a280 0x55bafd028400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc420a0 0x55bafd00dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2148760402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc298e0 0x55bafd017020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- 172.21.15.28:0/2148760402 >> 172.21.15.28:0/2148760402 conn(0x55bafcc5f350 msgr2=0x55bafd00d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- 172.21.15.28:0/2148760402 shutdown_connections 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- 172.21.15.28:0/2148760402 wait complete. 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 -- start start 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.483+0000 7f98a44b5740 1 Processor -- start 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc298e0 0x55bafd030fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc4a280 0x55bafd031a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02e9e0 con 0x55bafcc420a0 2024-09-21T07:06:03.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02e310 con 0x55bafcc4a280 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bafd02f0b0 con 0x55bafcc298e0 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98a44b5740 10 client.0 _ll_register_callbacks cb 0x7f988800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48060/0 (socket says 172.21.15.28:48060) 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 -- 172.21.15.28:0/2509694780 learned_addr learned my addr 172.21.15.28:0/2509694780 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f98977fe640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc298e0 0x55bafd030fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 -- 172.21.15.28:0/2509694780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc298e0 msgr2=0x55bafd030fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc298e0 0x55bafd030fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 -- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc4a280 msgr2=0x55bafd031a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9897fff640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc4a280 0x55bafd031a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc4a280 0x55bafd031a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 -- 172.21.15.28:0/2509694780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bafd0367d0 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9896ffd640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f988c032af0 tx=0x7f988c003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bea7d22cfd1d5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.484+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c049070 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f988c0d7120 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f989001f8c0 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f988c0cd960 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 10 client.15204 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bafd0367d0 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c08e050 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f988c091080 con 0x55bafcc420a0 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 10 client.15204 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 10 client.15204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 20 client.15204 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc6af60 0x55bafd09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 4 client.15204 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 --> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] -- command(tid 0: {"prefix": "status"}) -- 0x7f989001f8c0 con 0x55bafcc6af60 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.485+0000 7f98977fe640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc6af60 0x55bafd09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f9876ffd640 10 client.15204 ms_handle_connect on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98977fe640 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc6af60 0x55bafd09d8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abbe3a7dfd130d3 server_cookie=b51565b24b3c8409 in_seq=0 out_seq=0 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f9876ffd640 1 -- 172.21.15.28:0/2509694780 <== mds.0 v2:172.21.15.129:6838/903226333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x7f989001f8c0 con 0x55bafcc6af60 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f9876ffd640 10 client.15204 handle_command_reply: tid=0 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 client.15204 shutdown 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 msgr2=0x55bafd0314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f988c032af0 tx=0x7f988c003e80 comp rx=0 tx=0).stop 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 shutdown_connections 2024-09-21T07:06:03.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55bafcc4a280 0x55bafd031a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x55bafcc6af60 0x55bafd09d8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bafcc420a0 0x55bafd0314f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 --2- 172.21.15.28:0/2509694780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bafcc298e0 0x55bafd030fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f9876ffd640 0 client.15204 ms_handle_reset on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.486+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 >> 172.21.15.28:0/2509694780 conn(0x55bafcc5f350 msgr2=0x55bafd00ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 shutdown_connections 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f98a44b5740 1 -- 172.21.15.28:0/2509694780 wait complete. 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f98a44b5740 20 client.15204 trim_cache size 0 max 16384 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:03.494 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24635, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 82.423647101, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 93.605899539999996 2024-09-21T07:06:03.495 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 msgr2=0x7f98800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 0x7f98800b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9890005fd0 tx=0x7f9890009800 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 msgr2=0x7f989810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f988c02a930 tx=0x7f988c004270 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 shutdown_connections 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f98800b65a0 0x7f98800b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9898109df0 0x7f98981a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98981094a0 0x7f989810daa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 --2- 172.21.15.28:0/4059885055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9898103b60 0x7f989810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.487+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 >> 172.21.15.28:0/4059885055 conn(0x7f989807b850 msgr2=0x7f9898102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:03.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.488+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 shutdown_connections 2024-09-21T07:06:03.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:03.488+0000 7f989df41640 1 -- 172.21.15.28:0/4059885055 wait complete. 2024-09-21T07:06:03.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:03 smithi129 ceph-mon[34863]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:03 smithi181 ceph-mon[34686]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:03.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:03 smithi028 ceph-mon[31213]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:04.328 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:06:04.328 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:06:04.347 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T07:06:04.347 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:06:04.614 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 -- 172.21.15.28:0/110631655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e0106960 msgr2=0x7ff2e0108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 --2- 172.21.15.28:0/110631655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e0106960 0x7ff2e0108d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009900 tx=0x7ff2d002a410 comp rx=0 tx=0).stop 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 -- 172.21.15.28:0/110631655 shutdown_connections 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 --2- 172.21.15.28:0/110631655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e01094a0 0x7ff2e010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 --2- 172.21.15.28:0/110631655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e0106960 0x7ff2e0108d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 --2- 172.21.15.28:0/110631655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e006c600 0x7ff2e0106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.099+0000 7ff2e808b640 1 -- 172.21.15.28:0/110631655 >> 172.21.15.28:0/110631655 conn(0x7ff2e00fdfe0 msgr2=0x7ff2e0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 -- 172.21.15.28:0/110631655 shutdown_connections 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 -- 172.21.15.28:0/110631655 wait complete. 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 Processor -- start 2024-09-21T07:06:05.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 -- start start 2024-09-21T07:06:05.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:05.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e0106960 0x7ff2e019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.100+0000 7ff2e808b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e01094a0 0x7ff2e019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e808b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e010f390 con 0x7ff2e006c600 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e808b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e010f210 con 0x7ff2e0106960 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e808b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e010f510 con 0x7ff2e01094a0 2024-09-21T07:06:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48074/0 (socket says 172.21.15.28:48074) 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 -- 172.21.15.28:0/1214701441 learned_addr learned my addr 172.21.15.28:0/1214701441 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5626640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e0106960 0x7ff2e019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e6628640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e01094a0 0x7ff2e019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 -- 172.21.15.28:0/1214701441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e01094a0 msgr2=0x7ff2e019b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e01094a0 0x7ff2e019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 -- 172.21.15.28:0/1214701441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e0106960 msgr2=0x7ff2e019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e0106960 0x7ff2e019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 -- 172.21.15.28:0/1214701441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e019b900 con 0x7ff2e006c600 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e5e27640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c920 tx=0x7ff2dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc007c70 con 0x7ff2e006c600 2024-09-21T07:06:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2dc007e10 con 0x7ff2e006c600 2024-09-21T07:06:05.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc018820 con 0x7ff2e006c600 2024-09-21T07:06:05.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e019bbf0 con 0x7ff2e006c600 2024-09-21T07:06:05.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.101+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e01a2380 con 0x7ff2e006c600 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.102+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e0106d70 con 0x7ff2e006c600 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.104+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff2dc00f450 con 0x7ff2e006c600 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.105+0000 7ff2d6ffd640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.105+0000 7ff2e5626640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.105+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff2dc0e78b0 con 0x7ff2e006c600 2024-09-21T07:06:05.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.105+0000 7ff2e5626640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0000c00 tx=0x7ff2d0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:05.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.108+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2dc014030 con 0x7ff2e006c600 2024-09-21T07:06:05.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.313+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff2e0063800 con 0x7ff2cc0b65a0 2024-09-21T07:06:05.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.314+0000 7ff2d6ffd640 1 -- 172.21.15.28:0/1214701441 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff2e0063800 con 0x7ff2cc0b65a0 2024-09-21T07:06:05.316 INFO:teuthology.orchestra.run.smithi028.stdout:Backend: cephadm 2024-09-21T07:06:05.316 INFO:teuthology.orchestra.run.smithi028.stdout:Available: Yes 2024-09-21T07:06:05.316 INFO:teuthology.orchestra.run.smithi028.stdout:Paused: No 2024-09-21T07:06:05.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.316+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 msgr2=0x7ff2cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:05.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.316+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0000c00 tx=0x7ff2d0031400 comp rx=0 tx=0).stop 2024-09-21T07:06:05.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 msgr2=0x7ff2e0199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:05.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c920 tx=0x7ff2dc00cde0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 shutdown_connections 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e01094a0 0x7ff2e019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2e0106960 0x7ff2e019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 --2- 172.21.15.28:0/1214701441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2e006c600 0x7ff2e0199f60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 >> 172.21.15.28:0/1214701441 conn(0x7ff2e00fdfe0 msgr2=0x7ff2e0104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 shutdown_connections 2024-09-21T07:06:05.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:05.317+0000 7ff2e808b640 1 -- 172.21.15.28:0/1214701441 wait complete. 2024-09-21T07:06:05.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:05 smithi129 ceph-mon[34863]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:06:05.613 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:05 smithi028 ceph-mon[31213]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:06:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:05 smithi181 ceph-mon[34686]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:06:05.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:06:06.266 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:06.652 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:06 smithi028 ceph-mon[31213]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:06.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:06 smithi181 ceph-mon[34686]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 -- 172.21.15.28:0/1924940749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 msgr2=0x7fb7bc108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 --2- 172.21.15.28:0/1924940749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc108d30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009900 tx=0x7fb7a402a410 comp rx=0 tx=0).stop 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 -- 172.21.15.28:0/1924940749 shutdown_connections 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 --2- 172.21.15.28:0/1924940749 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc109470 0x7fb7bc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 --2- 172.21.15.28:0/1924940749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc108d30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 --2- 172.21.15.28:0/1924940749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc101b20 0x7fb7bc101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 -- 172.21.15.28:0/1924940749 >> 172.21.15.28:0/1924940749 conn(0x7fb7bc0fd770 msgr2=0x7fb7bc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 -- 172.21.15.28:0/1924940749 shutdown_connections 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.746+0000 7fb7c0990640 1 -- 172.21.15.28:0/1924940749 wait complete. 2024-09-21T07:06:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 Processor -- start 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 -- start start 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc101b20 0x7fb7bc199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc109470 0x7fb7bc19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc10f380 con 0x7fb7bc102550 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc10f200 con 0x7fb7bc101b20 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.747+0000 7fb7c0990640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc10f500 con 0x7fb7bc109470 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48092/0 (socket says 172.21.15.28:48092) 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 -- 172.21.15.28:0/3265063679 learned_addr learned my addr 172.21.15.28:0/3265063679 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7ba59c640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc101b20 0x7fb7bc199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7bad9d640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc109470 0x7fb7bc19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 -- 172.21.15.28:0/3265063679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc109470 msgr2=0x7fb7bc19b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:06.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc109470 0x7fb7bc19b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 -- 172.21.15.28:0/3265063679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc101b20 msgr2=0x7fb7bc199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc101b20 0x7fb7bc199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 -- 172.21.15.28:0/3265063679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc19ba00 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b3fff640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4006010 tx=0x7fb7a4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a403f030 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc19bc90 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.748+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a4003cb0 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.749+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4035070 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.749+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc1a23f0 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.750+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79c0052c0 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.751+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb7a4042030 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.752+0000 7fb7b37fe640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 0x7fb7a80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.752+0000 7fb7ba59c640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 0x7fb7a80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.752+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a4108140 con 0x7fb7bc102550 2024-09-21T07:06:06.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.753+0000 7fb7ba59c640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 0x7fb7a80b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005fd0 tx=0x7fb7ac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:06.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.756+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7a40ce880 con 0x7fb7bc102550 2024-09-21T07:06:06.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:06 smithi129 ceph-mon[34863]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:06.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.954+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb79c000bf0 con 0x7fb7a80b65a0 2024-09-21T07:06:06.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.966+0000 7fb7b37fe640 1 -- 172.21.15.28:0/3265063679 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fb79c000bf0 con 0x7fb7a80b65a0 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.a smithi028 running (100s) 18s ago 99s 88.2M - 19.3.0-5120-g18432218 ddce307e1f32 97d9facfd829 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.b smithi129 running (97s) 30s ago 97s 94.1M - 19.3.0-5120-g18432218 ddce307e1f32 7efaf9c999d7 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.c smithi181 running (111s) 30s ago 111s 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 9f7db5bf18be 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.d smithi028 running (119s) 18s ago 118s 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 b6353830e645 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.e smithi129 running (116s) 30s ago 116s 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 08090609e6de 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.f smithi181 running (114s) 30s ago 113s 84.0M - 19.3.0-5120-g18432218 ddce307e1f32 e52b33f81b48 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.g smithi028 running (103s) 18s ago 103s 82.6M - 19.3.0-5120-g18432218 ddce307e1f32 9d5d12c0511a 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.h smithi129 running (108s) 30s ago 108s 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 91ff64ddacf6 2024-09-21T07:06:06.968 INFO:teuthology.orchestra.run.smithi028.stdout:mds.i smithi181 running (106s) 30s ago 105s 84.9M - 19.3.0-5120-g18432218 ddce307e1f32 66c8c5f6d763 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mds.j smithi028 running (2m) 18s ago 2m 84.6M - 19.3.0-5120-g18432218 ddce307e1f32 d94c7f1bf0e1 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mds.k smithi129 running (2m) 30s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 736e7a637dc6 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mds.l smithi181 running (2m) 30s ago 2m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 2b5c6a77d936 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.x smithi028 *:9283,8765 running (9m) 18s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 91a0a7905358 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.y smithi129 *:8443,8765 running (7m) 30s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 b1e5600d22b9 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.z smithi181 *:8443,8765 running (7m) 30s ago 7m 523M - 19.3.0-5120-g18432218 ddce307e1f32 6ba9c735d6d2 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mon.a smithi028 running (9m) 18s ago 9m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 dca5c62bfebe 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mon.b smithi129 running (8m) 30s ago 8m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 9250081be069 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:mon.c smithi181 running (8m) 30s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 2b2c7be05215 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:osd.0 smithi028 running (7m) 18s ago 7m 123M 4273M 19.3.0-5120-g18432218 ddce307e1f32 24b4ecebaee4 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:osd.1 smithi129 running (6m) 30s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 506fde3775ca 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:osd.2 smithi181 running (6m) 30s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 76b436b904f9 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:osd.3 smithi028 running (5m) 18s ago 5m 123M 4273M 19.3.0-5120-g18432218 ddce307e1f32 76dd09db020a 2024-09-21T07:06:06.969 INFO:teuthology.orchestra.run.smithi028.stdout:osd.4 smithi129 running (5m) 30s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6d0c2b7b1302 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.5 smithi181 running (5m) 30s ago 5m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d4659c8d4891 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.6 smithi028 running (4m) 18s ago 4m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 83be68012774 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.7 smithi129 running (4m) 30s ago 4m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f4d1ac6309dd 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.8 smithi181 running (3m) 30s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f6a8875ad104 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.9 smithi028 running (3m) 18s ago 3m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 207c6058e76d 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.10 smithi129 running (2m) 30s ago 2m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 30870fd07351 2024-09-21T07:06:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:osd.11 smithi181 running (2m) 30s ago 2m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1ebd3ab3b177 2024-09-21T07:06:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 msgr2=0x7fb7a80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 0x7fb7a80b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005fd0 tx=0x7fb7ac00b390 comp rx=0 tx=0).stop 2024-09-21T07:06:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 msgr2=0x7fb7bc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4006010 tx=0x7fb7a4004340 comp rx=0 tx=0).stop 2024-09-21T07:06:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 shutdown_connections 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb7a80b65a0 0x7fb7a80b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7bc109470 0x7fb7bc19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb7bc102550 0x7fb7bc19a640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 --2- 172.21.15.28:0/3265063679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb7bc101b20 0x7fb7bc199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 >> 172.21.15.28:0/3265063679 conn(0x7fb7bc0fd770 msgr2=0x7fb7bc10a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 shutdown_connections 2024-09-21T07:06:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:06.969+0000 7fb7c0990640 1 -- 172.21.15.28:0/3265063679 wait complete. 2024-09-21T07:06:07.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:07 smithi129 ceph-mon[34863]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:07.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:07 smithi129 ceph-mon[34863]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:07.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:07 smithi028 ceph-mon[31213]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:07.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:07 smithi028 ceph-mon[31213]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:07.716 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:06:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:07 smithi181 ceph-mon[34686]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:07 smithi181 ceph-mon[34686]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 -- 172.21.15.28:0/2008684555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa41040a0 msgr2=0x7f4aa410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 --2- 172.21.15.28:0/2008684555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa41040a0 0x7f4aa410aa40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009ca0 tx=0x7f4a9c02a950 comp rx=0 tx=0).stop 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 -- 172.21.15.28:0/2008684555 shutdown_connections 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 --2- 172.21.15.28:0/2008684555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa41040a0 0x7f4aa410aa40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 --2- 172.21.15.28:0/2008684555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4103700 0x7f4aa4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 --2- 172.21.15.28:0/2008684555 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa4102670 0x7f4aa4102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 -- 172.21.15.28:0/2008684555 >> 172.21.15.28:0/2008684555 conn(0x7f4aa40fdfe0 msgr2=0x7f4aa4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 -- 172.21.15.28:0/2008684555 shutdown_connections 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.450+0000 7f4aaa497640 1 -- 172.21.15.28:0/2008684555 wait complete. 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 Processor -- start 2024-09-21T07:06:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 -- start start 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 0x7f4aa4199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa41040a0 0x7f4aa419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa410e2f0 con 0x7f4aa4103700 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa410e170 con 0x7f4aa41040a0 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aaa497640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa410e470 con 0x7f4aa4102670 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48100/0 (socket says 172.21.15.28:48100) 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4a9bfff640 1 -- 172.21.15.28:0/1172725269 learned_addr learned my addr 172.21.15.28:0/1172725269 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aa8a34640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa41040a0 0x7f4aa419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.451+0000 7f4aa3fff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 0x7f4aa4199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 -- 172.21.15.28:0/1172725269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 msgr2=0x7f4aa4199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 0x7f4aa4199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 -- 172.21.15.28:0/1172725269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa41040a0 msgr2=0x7f4aa419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa41040a0 0x7f4aa419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 -- 172.21.15.28:0/1172725269 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa419b9d0 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aa3fff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 0x7f4aa4199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4a9bfff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d950 tx=0x7f4a8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c017070 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a8c009c30 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa419bcc0 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f620 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.452+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa41a23c0 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.453+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa41a2590 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.455+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4a8c010460 con 0x7f4aa4103700 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.456+0000 7f4aa1ffb640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 0x7f4a900b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.456+0000 7f4aa3fff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 0x7f4a900b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:08.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.456+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4a8c0e7030 con 0x7f4aa4103700 2024-09-21T07:06:08.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.456+0000 7f4aa3fff640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 0x7f4a900b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a940058c0 tx=0x7f4a94005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:08.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.459+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a8c0ad830 con 0x7f4aa4103700 2024-09-21T07:06:08.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.658+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f4aa40fff70 con 0x7f4a900b6620 2024-09-21T07:06:08.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.664+0000 7f4aa1ffb640 1 -- 172.21.15.28:0/1172725269 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f4aa40fff70 con 0x7f4a900b6620 2024-09-21T07:06:08.666 INFO:teuthology.orchestra.run.smithi028.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:06:08.666 INFO:teuthology.orchestra.run.smithi028.stdout:mds.all 12/12 32s ago 2m smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi129=b;smithi129=e;smithi129=h;smithi129=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T07:06:08.666 INFO:teuthology.orchestra.run.smithi028.stdout:mgr 3/3 32s ago 8m smithi028=x;smithi129=y;smithi181=z;count:3 2024-09-21T07:06:08.666 INFO:teuthology.orchestra.run.smithi028.stdout:mon 3/3 32s ago 8m smithi028:172.21.15.28=a;smithi129:172.21.15.129=b;smithi181:172.21.15.181=c;count:3 2024-09-21T07:06:08.666 INFO:teuthology.orchestra.run.smithi028.stdout:osd 12 32s ago - 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 msgr2=0x7f4a900b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 0x7f4a900b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a940058c0 tx=0x7f4a94005850 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 msgr2=0x7f4aa419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d950 tx=0x7f4a8c00de10 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 shutdown_connections 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f4a900b6620 0x7f4a900b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa41040a0 0x7f4aa419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aa4103700 0x7f4aa419a610 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 --2- 172.21.15.28:0/1172725269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4aa4102670 0x7f4aa4199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 >> 172.21.15.28:0/1172725269 conn(0x7f4aa40fdfe0 msgr2=0x7f4aa40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.666+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 shutdown_connections 2024-09-21T07:06:08.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:08.667+0000 7f4aaa497640 1 -- 172.21.15.28:0/1172725269 wait complete. 2024-09-21T07:06:09.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:06:09.653 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:09 smithi181 ceph-mon[34686]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:09 smithi181 ceph-mon[34686]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:09.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:09 smithi028 ceph-mon[31213]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:09.775 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:09 smithi028 ceph-mon[31213]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:09 smithi129 ceph-mon[34863]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:09.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:09 smithi129 ceph-mon[34863]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:10.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 -- 172.21.15.28:0/2854080688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98077060 msgr2=0x7fbe98075730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:10.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 --2- 172.21.15.28:0/2854080688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98077060 0x7fbe98075730 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009ca0 tx=0x7fbe9002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 -- 172.21.15.28:0/2854080688 shutdown_connections 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 --2- 172.21.15.28:0/2854080688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9810b770 0x7fbe9810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 --2- 172.21.15.28:0/2854080688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe98075c70 0x7fbe98076080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 --2- 172.21.15.28:0/2854080688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98077060 0x7fbe98075730 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 -- 172.21.15.28:0/2854080688 >> 172.21.15.28:0/2854080688 conn(0x7fbe980ff0e0 msgr2=0x7fbe98101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 -- 172.21.15.28:0/2854080688 shutdown_connections 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.137+0000 7fbe9f733640 1 -- 172.21.15.28:0/2854080688 wait complete. 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 Processor -- start 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 -- start start 2024-09-21T07:06:10.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe98077060 0x7fbe9819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 0x7fbe9819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe981115e0 con 0x7fbe98075c70 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98111460 con 0x7fbe98077060 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9f733640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98111760 con 0x7fbe9810b770 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9d4cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9d4cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48120/0 (socket says 172.21.15.28:48120) 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9d4cf640 1 -- 172.21.15.28:0/1106391233 learned_addr learned my addr 172.21.15.28:0/1106391233 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:10.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9ccce640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe98077060 0x7fbe9819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.138+0000 7fbe9dcd0640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 0x7fbe9819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 -- 172.21.15.28:0/1106391233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 msgr2=0x7fbe9819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 0x7fbe9819d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 -- 172.21.15.28:0/1106391233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe98077060 msgr2=0x7fbe9819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe98077060 0x7fbe9819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 -- 172.21.15.28:0/1106391233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9819dc90 con 0x7fbe98075c70 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9dcd0640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 0x7fbe9819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:10.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9d4cf640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbe90031b50 tx=0x7fbe90003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004040 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe90004690 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9819df20 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9002fdc0 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.139+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe981a4680 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.140+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe981a48b0 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.142+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbe900041e0 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.142+0000 7fbe967fc640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 0x7fbe800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.143+0000 7fbe9ccce640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 0x7fbe800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.143+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbe90108d10 con 0x7fbe98075c70 2024-09-21T07:06:10.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.143+0000 7fbe9ccce640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 0x7fbe800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009990 tx=0x7fbe8c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:10.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.145+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe900cf4e0 con 0x7fbe98075c70 2024-09-21T07:06:10.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.340+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbe980ffce0 con 0x7fbe800b65a0 2024-09-21T07:06:10.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.341+0000 7fbe967fc640 1 -- 172.21.15.28:0/1106391233 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbe980ffce0 con 0x7fbe800b65a0 2024-09-21T07:06:10.343 INFO:teuthology.orchestra.run.smithi028.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:06:10.343 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028 172.21.15.28 2024-09-21T07:06:10.343 INFO:teuthology.orchestra.run.smithi028.stdout:smithi129 172.21.15.129 2024-09-21T07:06:10.343 INFO:teuthology.orchestra.run.smithi028.stdout:smithi181 172.21.15.181 2024-09-21T07:06:10.343 INFO:teuthology.orchestra.run.smithi028.stdout:3 hosts in cluster 2024-09-21T07:06:10.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 msgr2=0x7fbe800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:10.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 0x7fbe800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009990 tx=0x7fbe8c009110 comp rx=0 tx=0).stop 2024-09-21T07:06:10.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 msgr2=0x7fbe9819c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:10.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbe90031b50 tx=0x7fbe90003ba0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 shutdown_connections 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fbe800b65a0 0x7fbe800b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe9810b770 0x7fbe9819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe98077060 0x7fbe9819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 --2- 172.21.15.28:0/1106391233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe98075c70 0x7fbe9819c260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 >> 172.21.15.28:0/1106391233 conn(0x7fbe980ff0e0 msgr2=0x7fbe980ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 shutdown_connections 2024-09-21T07:06:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:10.344+0000 7fbe9f733640 1 -- 172.21.15.28:0/1106391233 wait complete. 2024-09-21T07:06:11.134 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:06:11.397 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:11.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:11 smithi028 ceph-mon[31213]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:11.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:11 smithi028 ceph-mon[31213]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:11.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:11 smithi129 ceph-mon[34863]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:11.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:11 smithi129 ceph-mon[34863]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:11.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.896+0000 7fc5badb6640 1 -- 172.21.15.28:0/2661348691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 msgr2=0x7fc5b4103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.896+0000 7fc5badb6640 1 --2- 172.21.15.28:0/2661348691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4103bc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009900 tx=0x7fc5a402a480 comp rx=0 tx=0).stop 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 -- 172.21.15.28:0/2661348691 shutdown_connections 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 --2- 172.21.15.28:0/2661348691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 --2- 172.21.15.28:0/2661348691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b4104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 --2- 172.21.15.28:0/2661348691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4103bc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 -- 172.21.15.28:0/2661348691 >> 172.21.15.28:0/2661348691 conn(0x7fc5b40ff0c0 msgr2=0x7fc5b4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:11.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 -- 172.21.15.28:0/2661348691 shutdown_connections 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 -- 172.21.15.28:0/2661348691 wait complete. 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 Processor -- start 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.897+0000 7fc5badb6640 1 -- start start 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b410f370 con 0x7fc5b4103750 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b410f1f0 con 0x7fc5b4105180 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5badb6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b410f4f0 con 0x7fc5b41047e0 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48136/0 (socket says 172.21.15.28:48136) 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 -- 172.21.15.28:0/3870420722 learned_addr learned my addr 172.21.15.28:0/3870420722 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b3fff640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b9353640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 -- 172.21.15.28:0/3870420722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 msgr2=0x7fc5b419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 -- 172.21.15.28:0/3870420722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 msgr2=0x7fc5b419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 -- 172.21.15.28:0/3870420722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b419b9d0 con 0x7fc5b4103750 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b3fff640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b9353640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.898+0000 7fc5b8b52640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4006010 tx=0x7fc5a4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:11.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.899+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a403f030 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.899+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a4003cb0 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.899+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b419bc60 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.899+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4035070 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.899+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b41a21f0 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.900+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b410a930 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.902+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc5a4042030 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.902+0000 7fc5b1ffb640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 0x7fc59c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.902+0000 7fc5b3fff640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 0x7fc59c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.903+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc5a4108260 con 0x7fc5b4103750 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.903+0000 7fc5b3fff640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 0x7fc59c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80058c0 tx=0x7fc5a8005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:11.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:11.906+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5a40ce9a0 con 0x7fc5b4103750 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:11 smithi181 ceph-mon[34686]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:11 smithi181 ceph-mon[34686]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:12.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.102+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc5b4063800 con 0x7fc59c0b65a0 2024-09-21T07:06:12.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.104+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3870420722 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc5b4063800 con 0x7fc59c0b65a0 2024-09-21T07:06:12.105 INFO:teuthology.orchestra.run.smithi028.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:06:12.105 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747401F4480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:06:12.105 INFO:teuthology.orchestra.run.smithi028.stdout:smithi129 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300HY400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:06:12.105 INFO:teuthology.orchestra.run.smithi028.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:06:12.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 msgr2=0x7fc59c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 0x7fc59c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80058c0 tx=0x7fc5a8005d30 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 msgr2=0x7fc5b4199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4006010 tx=0x7fc5a4004340 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 shutdown_connections 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc59c0b65a0 0x7fc59c0b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5b4105180 0x7fc5b419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5b41047e0 0x7fc5b419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 --2- 172.21.15.28:0/3870420722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4103750 0x7fc5b4199fa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 >> 172.21.15.28:0/3870420722 conn(0x7fc5b40ff0c0 msgr2=0x7fc5b4107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 shutdown_connections 2024-09-21T07:06:12.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:12.107+0000 7fc5badb6640 1 -- 172.21.15.28:0/3870420722 wait complete. 2024-09-21T07:06:12.875 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:06:12.883 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T07:06:12.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T07:06:13.144 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 -- 172.21.15.28:0/2583049245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 msgr2=0x7f3718102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 --2- 172.21.15.28:0/2583049245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718102ae0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3708009900 tx=0x7f370802a480 comp rx=0 tx=0).stop 2024-09-21T07:06:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 -- 172.21.15.28:0/2583049245 shutdown_connections 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 --2- 172.21.15.28:0/2583049245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 --2- 172.21.15.28:0/2583049245 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 0x7f3718103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.663+0000 7f371d8d9640 1 --2- 172.21.15.28:0/2583049245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718102ae0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.664+0000 7f371d8d9640 1 -- 172.21.15.28:0/2583049245 >> 172.21.15.28:0/2583049245 conn(0x7f37180fe000 msgr2=0x7f3718100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.664+0000 7f371d8d9640 1 -- 172.21.15.28:0/2583049245 shutdown_connections 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.664+0000 7f371d8d9640 1 -- 172.21.15.28:0/2583049245 wait complete. 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.664+0000 7f371d8d9640 1 Processor -- start 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.664+0000 7f371d8d9640 1 -- start start 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 0x7f3718199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f371810e2b0 con 0x7f3718102670 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f371810e130 con 0x7f3718103700 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371d8d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f371810e430 con 0x7f37181040a0 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50118/0 (socket says 172.21.15.28:50118) 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 -- 172.21.15.28:0/3655454777 learned_addr learned my addr 172.21.15.28:0/3655454777 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f37167fc640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 0x7f3718199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f37177fe640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 -- 172.21.15.28:0/3655454777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 msgr2=0x7f371819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 -- 172.21.15.28:0/3655454777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 msgr2=0x7f3718199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 0x7f3718199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 -- 172.21.15.28:0/3655454777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371819a910 con 0x7f3718102670 2024-09-21T07:06:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f37177fe640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f3716ffd640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3708006010 tx=0x7f37080043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.665+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370803f030 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.666+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371819aba0 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.666+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3708003cb0 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.666+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708035070 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.666+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181a1130 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.667+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3718109850 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.668+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3708042030 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.669+0000 7f371c8d7640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 0x7f37000b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.669+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f37081083b0 con 0x7f3718102670 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.669+0000 7f37167fc640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 0x7f37000b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.670+0000 7f37167fc640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 0x7f37000b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f370c0058c0 tx=0x7f370c00a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:13.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.673+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37080ceaf0 con 0x7f3718102670 2024-09-21T07:06:13.800 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:13 smithi028 ceph-mon[31213]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:13.801 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:13 smithi028 ceph-mon[31213]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:13.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:13 smithi129 ceph-mon[34863]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:13.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:13 smithi129 ceph-mon[34863]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:13.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.900+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f371802e800 con 0x7f3718102670 2024-09-21T07:06:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.900+0000 7f371c8d7640 1 -- 172.21.15.28:0/3655454777 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3088 (secure 0 0 0) 0x7f371802e800 con 0x7f3718102670 2024-09-21T07:06:13.903 INFO:teuthology.orchestra.run.smithi028.stdout:e24 2024-09-21T07:06:13.903 INFO:teuthology.orchestra.run.smithi028.stdout:btime 2024-09-21T07:04:52:347225+0000 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:legacy client fscid: 1 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:Filesystem 'cephfs' (1) 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:fs_name cephfs 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 24 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-09-21T07:04:40.762217+0000 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:modified 2024-09-21T07:04:52.055120+0000 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:tableserver 0 2024-09-21T07:06:13.904 INFO:teuthology.orchestra.run.smithi028.stdout:root 0 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:session_timeout 300 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:session_autoclose 300 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:max_file_size 1099511627776 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:max_xattr_size 65536 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:required_client_features {} 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:last_failure 0 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:last_failure_osd_epoch 0 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:max_mds 3 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:in 0,1,2 2024-09-21T07:06:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:up {0=24635,1=24623,2=24616} 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:failed 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:damaged 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:stopped 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:data_pools [3] 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:metadata_pool 2 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:inline_data disabled 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:balancer 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:bal_rank_mask -1 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:standby_count_wanted 0 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:qdb_cluster leader: 24635 members: 24616,24623,24635 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b{0:24635} state up:active seq 4 addr [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.906 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.h{0:24599} state up:standby-replay seq 1 addr [v2:172.21.15.129:6836/2275077942,v1:172.21.15.129:6837/2275077942] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a{1:24623} state up:active seq 7 addr [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c{1:24595} state up:standby-replay seq 1 addr [v2:172.21.15.181:6836/499879490,v1:172.21.15.181:6837/499879490] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.i{2:24616} state up:active seq 9 addr [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.f{2:24589} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/1882677876,v1:172.21.15.181:6835/1882677876] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:Standby daemons: 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.j{-1:14721} state up:standby seq 1 addr [v2:172.21.15.28:6834/2354310763,v1:172.21.15.28:6835/2354310763] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d{-1:14733} state up:standby seq 1 addr [v2:172.21.15.28:6836/2155481344,v1:172.21.15.28:6837/2155481344] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.g{-1:14787} state up:standby seq 1 addr [v2:172.21.15.28:6838/4017087846,v1:172.21.15.28:6839/4017087846] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.907 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.k{-1:24542} state up:standby seq 1 addr [v2:172.21.15.129:6832/4256209134,v1:172.21.15.129:6833/4256209134] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.908 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.l{-1:24550} state up:standby seq 1 addr [v2:172.21.15.181:6832/2982677704,v1:172.21.15.181:6833/2982677704] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.908 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.e{-1:24569} state up:standby seq 1 addr [v2:172.21.15.129:6834/3637531952,v1:172.21.15.129:6835/3637531952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 msgr2=0x7f37000b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 0x7f37000b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f370c0058c0 tx=0x7f370c00a4c0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 msgr2=0x7f3718198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3708006010 tx=0x7f37080043b0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 shutdown_connections 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f37000b65a0 0x7f37000b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37181040a0 0x7f371819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3718103700 0x7f3718199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 --2- 172.21.15.28:0/3655454777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3718102670 0x7f3718198ee0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 >> 172.21.15.28:0/3655454777 conn(0x7f37180fe000 msgr2=0x7f3718106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 shutdown_connections 2024-09-21T07:06:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:13.903+0000 7f371d8d9640 1 -- 172.21.15.28:0/3655454777 wait complete. 2024-09-21T07:06:14.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:13 smithi181 ceph-mon[34686]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:14.021 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:13 smithi181 ceph-mon[34686]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:14.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T07:06:14.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:14 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3655454777' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:06:14.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:14 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3655454777' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:06:14.956 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:14 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3655454777' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 -- 172.21.15.28:0/2821414827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b0109480 msgr2=0x7f92b010b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 --2- 172.21.15.28:0/2821414827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b0109480 0x7f92b010b990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009ca0 tx=0x7f92a002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 -- 172.21.15.28:0/2821414827 shutdown_connections 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 --2- 172.21.15.28:0/2821414827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b0109480 0x7f92b010b990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 --2- 172.21.15.28:0/2821414827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 0x7f92b0108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 --2- 172.21.15.28:0/2821414827 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b006b8e0 0x7f92b0106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 -- 172.21.15.28:0/2821414827 >> 172.21.15.28:0/2821414827 conn(0x7f92b00fdfb0 msgr2=0x7f92b0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 -- 172.21.15.28:0/2821414827 shutdown_connections 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.432+0000 7f92b5256640 1 -- 172.21.15.28:0/2821414827 wait complete. 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 Processor -- start 2024-09-21T07:06:15.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 -- start start 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 0x7f92b019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b0109480 0x7f92b019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92b010f390 con 0x7f92b006b8e0 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f92b010f210 con 0x7f92b0109480 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92b5256640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92b010f510 con 0x7f92b0106970 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50142/0 (socket says 172.21.15.28:50142) 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92aed9d640 1 -- 172.21.15.28:0/1863043001 learned_addr learned my addr 172.21.15.28:0/1863043001 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92ae59c640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 0x7f92b019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.433+0000 7f92af59e640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b0109480 0x7f92b019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 -- 172.21.15.28:0/1863043001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 msgr2=0x7f92b019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 0x7f92b019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 -- 172.21.15.28:0/1863043001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b0109480 msgr2=0x7f92b019b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b0109480 0x7f92b019b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 -- 172.21.15.28:0/1863043001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b019b900 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92aed9d640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c920 tx=0x7f92a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8007c70 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b019bbf0 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92a8007e10 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8018820 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.434+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b01a2380 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.435+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b00ffad0 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.437+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f92a800f450 con 0x7f92b006b8e0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.437+0000 7f92a7fff640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 0x7f929c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.437+0000 7f92ae59c640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 0x7f929c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.438+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f92a80e7370 con 0x7f92b006b8e0 2024-09-21T07:06:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.438+0000 7f92ae59c640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 0x7f929c0b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9298005fd0 tx=0x7f929800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.442+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92a8014030 con 0x7f92b006b8e0 2024-09-21T07:06:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.636+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f92b0063fc0 con 0x7f92b006b8e0 2024-09-21T07:06:15.638 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:15 smithi028 ceph-mon[31213]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:15.638 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:15 smithi028 ceph-mon[31213]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.637+0000 7f92a7fff640 1 -- 172.21.15.28:0/1863043001 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v74) ==== 56+0+5284 (secure 0 0 0) 0x7f92a80adc10 con 0x7f92b006b8e0 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 74 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-09-21T06:56:23.464820+0000 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:modified 2024-09-21T07:05:13.840205+0000 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:crush_version 26 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:full_ratio 0.95 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:backfillfull_ratio 0.9 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:nearfull_ratio 0.85 2024-09-21T07:06:15.639 INFO:teuthology.orchestra.run.smithi028.stdout:require_min_compat_client luminous 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:min_compat_client luminous 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:require_osd_release squid 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:stretch_mode_enabled false 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 72 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 72 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:max_osd 12 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6802/394219256,v1:172.21.15.28:6803/394219256] [v2:172.21.15.28:6804/394219256,v1:172.21.15.28:6805/394219256] exists,up f58e89f6-8401-4336-a335-96041060dc38 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.1 up in weight 1 up_from 13 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/1501531235,v1:172.21.15.129:6801/1501531235] [v2:172.21.15.129:6802/1501531235,v1:172.21.15.129:6803/1501531235] exists,up bac69547-8286-49a6-8ed8-bac8cf91e592 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.2 up in weight 1 up_from 17 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1137940490,v1:172.21.15.181:6801/1137940490] [v2:172.21.15.181:6802/1137940490,v1:172.21.15.181:6803/1137940490] exists,up 6691236c-3f1e-4af1-bb2d-e8f46ac32640 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.3 up in weight 1 up_from 23 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6810/1190124716,v1:172.21.15.28:6811/1190124716] [v2:172.21.15.28:6812/1190124716,v1:172.21.15.28:6813/1190124716] exists,up 9b22145b-f0e6-4fa1-ae2c-91614505ef38 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.4 up in weight 1 up_from 28 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6808/3815377982,v1:172.21.15.129:6809/3815377982] [v2:172.21.15.129:6810/3815377982,v1:172.21.15.129:6811/3815377982] exists,up efcbe4ce-405f-4668-8538-6547a3121baa 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.5 up in weight 1 up_from 33 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/2730863123,v1:172.21.15.181:6809/2730863123] [v2:172.21.15.181:6810/2730863123,v1:172.21.15.181:6811/2730863123] exists,up 23b58876-da54-434b-b8aa-ce70f8edbb39 2024-09-21T07:06:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:osd.6 up in weight 1 up_from 39 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6818/462044654,v1:172.21.15.28:6819/462044654] [v2:172.21.15.28:6820/462044654,v1:172.21.15.28:6821/462044654] exists,up f51f26d7-29dc-408b-af52-ab6dc9843352 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:osd.7 up in weight 1 up_from 44 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6816/3154062983,v1:172.21.15.129:6817/3154062983] [v2:172.21.15.129:6818/3154062983,v1:172.21.15.129:6819/3154062983] exists,up 1e70aae7-a7da-4d72-9e11-46cb44c01307 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:osd.8 up in weight 1 up_from 49 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/2560474309,v1:172.21.15.181:6817/2560474309] [v2:172.21.15.181:6818/2560474309,v1:172.21.15.181:6819/2560474309] exists,up e2f14ae0-ab04-4993-b332-289a45f543b6 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:osd.9 up in weight 1 up_from 55 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6826/1426799166,v1:172.21.15.28:6827/1426799166] [v2:172.21.15.28:6828/1426799166,v1:172.21.15.28:6829/1426799166] exists,up 651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:osd.10 up in weight 1 up_from 60 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6824/3634135642,v1:172.21.15.129:6825/3634135642] [v2:172.21.15.129:6826/3634135642,v1:172.21.15.129:6827/3634135642] exists,up e6135ba7-636d-41aa-824b-112eb23712f2 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:osd.11 up in weight 1 up_from 66 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/3397668181,v1:172.21.15.181:6825/3397668181] [v2:172.21.15.181:6826/3397668181,v1:172.21.15.181:6827/3397668181] exists,up 0442b0e3-81cf-42c5-a98b-00f0f4cd9472 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.1d [8,11] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.6 [4,6] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.1d [5,9] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.23 [4,7] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.27 [4,8] 2024-09-21T07:06:15.641 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.3b [3,9] 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/2008308045 expires 2024-09-22T06:57:12.164877+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/1068367434 expires 2024-09-22T06:57:12.164877+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6801/17761675 expires 2024-09-22T06:57:12.164877+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/2395738640 expires 2024-09-22T06:57:12.164877+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/1550047956 expires 2024-09-22T06:56:45.859801+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/454902326 expires 2024-09-22T06:56:45.859801+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6800/17761675 expires 2024-09-22T06:57:12.164877+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/3368385201 expires 2024-09-22T06:56:45.859801+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6801/4061456910 expires 2024-09-22T06:56:45.859801+0000 2024-09-21T07:06:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6800/4061456910 expires 2024-09-22T06:56:45.859801+0000 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 msgr2=0x7f929c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 0x7f929c0b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9298005fd0 tx=0x7f929800b390 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 msgr2=0x7f92b0199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c920 tx=0x7f92a800cde0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 shutdown_connections 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f929c0b6510 0x7f929c0b8a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92b0109480 0x7f92b019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92b0106970 0x7f92b019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 --2- 172.21.15.28:0/1863043001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92b006b8e0 0x7f92b0199f60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.639+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 >> 172.21.15.28:0/1863043001 conn(0x7f92b00fdfb0 msgr2=0x7f92b0104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.640+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 shutdown_connections 2024-09-21T07:06:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:15.640+0000 7f92b5256640 1 -- 172.21.15.28:0/1863043001 wait complete. 2024-09-21T07:06:15.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:15 smithi129 ceph-mon[34863]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:15.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:15 smithi129 ceph-mon[34863]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:06:16.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:15 smithi181 ceph-mon[34686]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:16.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:15 smithi181 ceph-mon[34686]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:06:16.283 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T07:06:16.293 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:06:16.552 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:16.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:16 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1863043001' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:06:16.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:16 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1863043001' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:06:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:16 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1863043001' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:06:17.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.064+0000 7f96e20c0640 1 -- 172.21.15.28:0/2804110479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc103b60 msgr2=0x7f96dc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:17.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.064+0000 7f96e20c0640 1 --2- 172.21.15.28:0/2804110479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc103b60 0x7f96dc103f70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009900 tx=0x7f96cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 -- 172.21.15.28:0/2804110479 shutdown_connections 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 --2- 172.21.15.28:0/2804110479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc109df0 0x7f96dc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 --2- 172.21.15.28:0/2804110479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc1094a0 0x7f96dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 --2- 172.21.15.28:0/2804110479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc103b60 0x7f96dc103f70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 -- 172.21.15.28:0/2804110479 >> 172.21.15.28:0/2804110479 conn(0x7f96dc07b850 msgr2=0x7f96dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 -- 172.21.15.28:0/2804110479 shutdown_connections 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 -- 172.21.15.28:0/2804110479 wait complete. 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 Processor -- start 2024-09-21T07:06:17.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.065+0000 7f96e20c0640 1 -- start start 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 0x7f96dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 0x7f96dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc113ab0 con 0x7f96dc1094a0 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc113930 con 0x7f96dc103b60 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96e20c0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc113c30 con 0x7f96dc109df0 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50162/0 (socket says 172.21.15.28:50162) 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 -- 172.21.15.28:0/4102598673 learned_addr learned my addr 172.21.15.28:0/4102598673 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:17.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96db7fe640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 0x7f96dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96dbfff640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 0x7f96dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 -- 172.21.15.28:0/4102598673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 msgr2=0x7f96dc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 0x7f96dc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 -- 172.21.15.28:0/4102598673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 msgr2=0x7f96dc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 0x7f96dc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 -- 172.21.15.28:0/4102598673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1a87c0 con 0x7f96dc1094a0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96dbfff640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 0x7f96dc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96db7fe640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 0x7f96dc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.066+0000 7f96d3fff640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c970 tx=0x7f96c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.067+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4007bb0 con 0x7f96dc1094a0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.067+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96c4007d50 con 0x7f96dc1094a0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.067+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1a8ab0 con 0x7f96dc1094a0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.067+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c400f450 con 0x7f96dc1094a0 2024-09-21T07:06:17.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.067+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1a8ff0 con 0x7f96dc1094a0 2024-09-21T07:06:17.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.068+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc103f70 con 0x7f96dc1094a0 2024-09-21T07:06:17.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.069+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f96c4004eb0 con 0x7f96dc1094a0 2024-09-21T07:06:17.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.070+0000 7f96d97fa640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 0x7f96c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:17.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.070+0000 7f96db7fe640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 0x7f96c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:17.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.070+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96c40e74c0 con 0x7f96dc1094a0 2024-09-21T07:06:17.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.071+0000 7f96db7fe640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 0x7f96c80b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96cc000c00 tx=0x7f96cc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.073+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96c4014030 con 0x7f96dc1094a0 2024-09-21T07:06:17.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.297+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96dc076a10 con 0x7f96dc1094a0 2024-09-21T07:06:17.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.298+0000 7f96d97fa640 1 -- 172.21.15.28:0/4102598673 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7f96c40add60 con 0x7f96dc1094a0 2024-09-21T07:06:17.301 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:17.301 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:06:17.301 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 msgr2=0x7f96c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 0x7f96c80b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96cc000c00 tx=0x7f96cc031400 comp rx=0 tx=0).stop 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 msgr2=0x7f96dc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c970 tx=0x7f96c400ce30 comp rx=0 tx=0).stop 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 shutdown_connections 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f96c80b6510 0x7f96c80b8a20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96dc109df0 0x7f96dc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96dc1094a0 0x7f96dc075c50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 --2- 172.21.15.28:0/4102598673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96dc103b60 0x7f96dc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:17.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 >> 172.21.15.28:0/4102598673 conn(0x7f96dc07b850 msgr2=0x7f96dc1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:17.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 shutdown_connections 2024-09-21T07:06:17.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:17.301+0000 7f96e20c0640 1 -- 172.21.15.28:0/4102598673 wait complete. 2024-09-21T07:06:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:17 smithi028 ceph-mon[31213]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:06:17.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:17 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4102598673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:17.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:17 smithi129 ceph-mon[34863]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:06:17.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:17 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4102598673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:17.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:06:18.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:17 smithi181 ceph-mon[34686]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:06:18.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:17 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4102598673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:18.224 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:18.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 -- 172.21.15.28:0/239210186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4750105270 msgr2=0x7f475010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:18.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 --2- 172.21.15.28:0/239210186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4750105270 0x7f475010d8b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4738009900 tx=0x7f473802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 -- 172.21.15.28:0/239210186 shutdown_connections 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 --2- 172.21.15.28:0/239210186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f475010ddf0 0x7f4750110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 --2- 172.21.15.28:0/239210186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4750105270 0x7f475010d8b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 --2- 172.21.15.28:0/239210186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 0x7f4750104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 -- 172.21.15.28:0/239210186 >> 172.21.15.28:0/239210186 conn(0x7f4750079730 msgr2=0x7f4750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 -- 172.21.15.28:0/239210186 shutdown_connections 2024-09-21T07:06:18.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.717+0000 7f4756502640 1 -- 172.21.15.28:0/239210186 wait complete. 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 Processor -- start 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 -- start start 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 0x7f475019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4750105270 0x7f475019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4750113a70 con 0x7f475010ddf0 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f47501138f0 con 0x7f4750104840 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4756502640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4750113bf0 con 0x7f4750105270 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4754a9f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:18.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4754a9f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50170/0 (socket says 172.21.15.28:50170) 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4754a9f640 1 -- 172.21.15.28:0/1068007700 learned_addr learned my addr 172.21.15.28:0/1068007700 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f474ffff640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 0x7f475019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.718+0000 7f4747fff640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4750105270 0x7f475019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 -- 172.21.15.28:0/1068007700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4750105270 msgr2=0x7f475019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4750105270 0x7f475019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 -- 172.21.15.28:0/1068007700 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 msgr2=0x7f475019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 0x7f475019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 -- 172.21.15.28:0/1068007700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47501a0310 con 0x7f475010ddf0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4754a9f640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f474800cce0 tx=0x7f474800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474800f450 con 0x7f475010ddf0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47501a0600 con 0x7f475010ddf0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47501a6e20 con 0x7f475010ddf0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f474800faa0 con 0x7f475010ddf0 2024-09-21T07:06:18.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.719+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4748018b70 con 0x7f475010ddf0 2024-09-21T07:06:18.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.720+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47300052c0 con 0x7f475010ddf0 2024-09-21T07:06:18.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.722+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f474800fc50 con 0x7f475010ddf0 2024-09-21T07:06:18.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.722+0000 7f474dffb640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 0x7f473c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:18.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.723+0000 7f474ffff640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 0x7f473c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:18.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.723+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f47480e7790 con 0x7f475010ddf0 2024-09-21T07:06:18.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.723+0000 7f474ffff640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 0x7f473c0b8ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f475006bc00 tx=0x7f4740005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:18.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.726+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4748014030 con 0x7f475010ddf0 2024-09-21T07:06:18.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.951+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47300055b0 con 0x7f475010ddf0 2024-09-21T07:06:18.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.952+0000 7f474dffb640 1 -- 172.21.15.28:0/1068007700 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11913 (secure 0 0 0) 0x7f47480ae140 con 0x7f475010ddf0 2024-09-21T07:06:18.954 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:18.954 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"btime":"2024-09-21T07:04:52:347225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:04:52.055120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24616,24623,24635]},"id":1}]} 2024-09-21T07:06:18.955 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 24 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 msgr2=0x7f473c0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 0x7f473c0b8ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f475006bc00 tx=0x7f4740005f90 comp rx=0 tx=0).stop 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 msgr2=0x7f475019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f474800cce0 tx=0x7f474800a620 comp rx=0 tx=0).stop 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 shutdown_connections 2024-09-21T07:06:18.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f473c0b65c0 0x7f473c0b8ad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f475010ddf0 0x7f475019fca0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4750105270 0x7f475019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 --2- 172.21.15.28:0/1068007700 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4750104840 0x7f475019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.954+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 >> 172.21.15.28:0/1068007700 conn(0x7f4750079730 msgr2=0x7f4750107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.955+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 shutdown_connections 2024-09-21T07:06:18.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:18.955+0000 7f4756502640 1 -- 172.21.15.28:0/1068007700 wait complete. 2024-09-21T07:06:19.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:06:19.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:19 smithi028 ceph-mon[31213]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:19.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:19 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1068007700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:19.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:19 smithi129 ceph-mon[34863]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:19.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:19 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1068007700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:19.892 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:19 smithi181 ceph-mon[34686]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:20.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:19 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1068007700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.402+0000 7f7131fc9640 1 -- 172.21.15.28:0/3138267571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 msgr2=0x7f712c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.402+0000 7f7131fc9640 1 --2- 172.21.15.28:0/3138267571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c10d8b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7120009900 tx=0x7f712002a410 comp rx=0 tx=0).stop 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.402+0000 7f7131fc9640 1 -- 172.21.15.28:0/3138267571 shutdown_connections 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 --2- 172.21.15.28:0/3138267571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c10ddf0 0x7f712c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 --2- 172.21.15.28:0/3138267571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c10d8b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 --2- 172.21.15.28:0/3138267571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c104840 0x7f712c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 -- 172.21.15.28:0/3138267571 >> 172.21.15.28:0/3138267571 conn(0x7f712c079730 msgr2=0x7f712c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 -- 172.21.15.28:0/3138267571 shutdown_connections 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 -- 172.21.15.28:0/3138267571 wait complete. 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.403+0000 7f7131fc9640 1 Processor -- start 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 -- start start 2024-09-21T07:06:20.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c104840 0x7f712c102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c10ddf0 0x7f712c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f712c113a70 con 0x7f712c105270 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1138f0 con 0x7f712c10ddf0 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f7131fc9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f712c113bf0 con 0x7f712c104840 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50186/0 (socket says 172.21.15.28:50186) 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 -- 172.21.15.28:0/1687062046 learned_addr learned my addr 172.21.15.28:0/1687062046 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712b7fe640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c104840 0x7f712c102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712bfff640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c10ddf0 0x7f712c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 -- 172.21.15.28:0/1687062046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c104840 msgr2=0x7f712c102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c104840 0x7f712c102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 -- 172.21.15.28:0/1687062046 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c10ddf0 msgr2=0x7f712c1031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.404+0000 7f712affd640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c10ddf0 0x7f712c1031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f712affd640 1 -- 172.21.15.28:0/1687062046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c1a86b0 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f712affd640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f712002a930 tx=0x7f7120004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712003f030 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7120003aa0 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120035070 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712c1a8940 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.405+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712c1a8dd0 con 0x7f712c105270 2024-09-21T07:06:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.406+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712c104c50 con 0x7f712c105270 2024-09-21T07:06:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.409+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7120042030 con 0x7f712c105270 2024-09-21T07:06:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.409+0000 7f7128ff9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 0x7f71140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.410+0000 7f712b7fe640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 0x7f71140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.410+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7120107dc0 con 0x7f712c105270 2024-09-21T07:06:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.410+0000 7f712b7fe640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 0x7f71140b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f712c1041a0 tx=0x7f711c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.413+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71200ce660 con 0x7f712c105270 2024-09-21T07:06:20.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.604+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f712c1a9130 con 0x7f712c105270 2024-09-21T07:06:20.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.605+0000 7f7128ff9640 1 -- 172.21.15.28:0/1687062046 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7f71200d2a40 con 0x7f712c105270 2024-09-21T07:06:20.608 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:06:20.608 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 msgr2=0x7f71140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 0x7f71140b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f712c1041a0 tx=0x7f711c005f90 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 msgr2=0x7f712c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f712002a930 tx=0x7f7120004270 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 shutdown_connections 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f71140b6510 0x7f71140b8a20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f712c10ddf0 0x7f712c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f712c105270 0x7f712c102c90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 --2- 172.21.15.28:0/1687062046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f712c104840 0x7f712c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:20.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.607+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 >> 172.21.15.28:0/1687062046 conn(0x7f712c079730 msgr2=0x7f712c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:20.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.608+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 shutdown_connections 2024-09-21T07:06:20.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:20.608+0000 7f7131fc9640 1 -- 172.21.15.28:0/1687062046 wait complete. 2024-09-21T07:06:21.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:04:40.762217+0000', 'modified': '2024-09-21T07:04:52.055120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24635, 'mds_1': 24623, 'mds_2': 24616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24589': {'gid': 24589, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1882677876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1882677876}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1882677876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/499879490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 499879490}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 499879490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.129:6837/2275077942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6836', 'nonce': 2275077942}, {'type': 'v1', 'addr': '172.21.15.129:6837', 'nonce': 2275077942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24616': {'gid': 24616, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6839/76790251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 76790251}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 76790251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.28:6841/1067476795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6840', 'nonce': 1067476795}, {'type': 'v1', 'addr': '172.21.15.28:6841', 'nonce': 1067476795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.129:6839/903226333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6838', 'nonce': 903226333}, {'type': 'v1', 'addr': '172.21.15.129:6839', 'nonce': 903226333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24635, 'qdb_cluster': [24616, 24623, 24635]} 2024-09-21T07:06:21.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T07:06:21.379 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:06:21.640 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:21.761 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:21 smithi028 ceph-mon[31213]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:21.762 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:21 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1687062046' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:21.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:21 smithi129 ceph-mon[34863]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:21.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:21 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1687062046' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:21 smithi181 ceph-mon[34686]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:22.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:21 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1687062046' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 -- 172.21.15.28:0/2747334209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb41083a0 msgr2=0x7f7cb41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/2747334209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb41083a0 0x7f7cb41087b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009900 tx=0x7f7ca402a410 comp rx=0 tx=0).stop 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 -- 172.21.15.28:0/2747334209 shutdown_connections 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/2747334209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb4108cf0 0x7f7cb410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/2747334209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb41083a0 0x7f7cb41087b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/2747334209 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4102a60 0x7f7cb4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 -- 172.21.15.28:0/2747334209 >> 172.21.15.28:0/2747334209 conn(0x7f7cb4079730 msgr2=0x7f7cb4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 -- 172.21.15.28:0/2747334209 shutdown_connections 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.138+0000 7f7cbbb15640 1 -- 172.21.15.28:0/2747334209 wait complete. 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.139+0000 7f7cbbb15640 1 Processor -- start 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.139+0000 7f7cbbb15640 1 -- start start 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb41083a0 0x7f7cb40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4108cf0 0x7f7cb41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41129a0 con 0x7f7cb4102a60 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4112820 con 0x7f7cb4108cf0 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cbbb15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4112b20 con 0x7f7cb41083a0 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50194/0 (socket says 172.21.15.28:50194) 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 -- 172.21.15.28:0/1792723483 learned_addr learned my addr 172.21.15.28:0/1792723483 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb41083a0 0x7f7cb40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4108cf0 0x7f7cb41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 -- 172.21.15.28:0/1792723483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb41083a0 msgr2=0x7f7cb40ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb41083a0 0x7f7cb40ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 -- 172.21.15.28:0/1792723483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4108cf0 msgr2=0x7f7cb41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4108cf0 0x7f7cb41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 -- 172.21.15.28:0/1792723483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb41a87c0 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.140+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000d950 tx=0x7f7cb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.141+0000 7f7caaffd640 1 -- 172.21.15.28:0/1792723483 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0017070 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.141+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb41a8ab0 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.141+0000 7f7caaffd640 1 -- 172.21.15.28:0/1792723483 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb0009c30 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.141+0000 7f7caaffd640 1 -- 172.21.15.28:0/1792723483 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000f620 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.141+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb41a8fc0 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.143+0000 7f7caaffd640 1 -- 172.21.15.28:0/1792723483 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7cb0010460 con 0x7f7cb4102a60 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.143+0000 7f7cc2089740 1 Processor -- start 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 -- start start 2024-09-21T07:06:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee017440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee017980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5570edf8ec10 con 0x5570edc70f60 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5570edf7e040 con 0x5570edc50280 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cc2089740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570edf81e50 con 0x5570edc480a0 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50208/0 (socket says 172.21.15.28:50208) 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 -- 172.21.15.28:0/3204973673 learned_addr learned my addr 172.21.15.28:0/3204973673 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee017440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee017980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 -- 172.21.15.28:0/3204973673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 msgr2=0x5570ee017440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee017440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 -- 172.21.15.28:0/3204973673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 msgr2=0x5570ee017980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.144+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee017980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7cba0b2640 1 -- 172.21.15.28:0/3204973673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570edcdc540 con 0x5570edc70f60 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7caaffd640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 0x7f7ca00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 0x7f7ca00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a430 tx=0x7f7cac009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c91e9398cc1c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7c9ffff640 1 -- 172.21.15.28:0/3204973673 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac013790 con 0x5570edc70f60 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7caaffd640 1 -- 172.21.15.28:0/1792723483 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7cb00e6e80 con 0x7f7cb4102a60 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7c9ffff640 1 -- 172.21.15.28:0/3204973673 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cac019070 con 0x5570edc70f60 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.145+0000 7f7c9ffff640 1 -- 172.21.15.28:0/3204973673 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac014ce0 con 0x5570edc70f60 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- 172.21.15.28:0/3204973673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 msgr2=0x5570ee016f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cb98b1640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 0x7f7ca00b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5570ee015b80 tx=0x7f7cb00ea960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a430 tx=0x7f7cac009650 comp rx=0 tx=0).stop 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- 172.21.15.28:0/3204973673 shutdown_connections 2024-09-21T07:06:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee017980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee017440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 --2- 172.21.15.28:0/3204973673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee016f00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- 172.21.15.28:0/3204973673 >> 172.21.15.28:0/3204973673 conn(0x5570edc65350 msgr2=0x5570ee014df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- 172.21.15.28:0/3204973673 shutdown_connections 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- 172.21.15.28:0/3204973673 wait complete. 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.146+0000 7f7cc2089740 1 -- start start 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 Processor -- start 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee0229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee022ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5570edddf5f0 con 0x5570edc70f60 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5570edf19010 con 0x5570edc50280 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570ee0256e0 con 0x5570edc480a0 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cc2089740 10 client.0 _ll_register_callbacks cb 0x5570edf78340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50218/0 (socket says 172.21.15.28:50218) 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2700913479 learned_addr learned my addr 172.21.15.28:0/2700913479 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee022ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.147+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee0229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 msgr2=0x5570ee0229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee0229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2700913479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 msgr2=0x5570ee022ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee022ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2700913479 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570edf46a00 con 0x5570edc70f60 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7cac007090 tx=0x7f7cac0148c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ed309e5e728c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7c9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac013790 con 0x5570edc70f60 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7cac013930 con 0x5570edc70f60 2024-09-21T07:06:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cac019070 con 0x5570edc70f60 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cac013b30 con 0x5570edc70f60 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cc2089740 10 client.15276 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5570ee0315d0 con 0x5570edc70f60 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.148+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cac019070 con 0x5570edc70f60 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cac02b3e0 con 0x5570edc70f60 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 10 client.15276 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 10 client.15276 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 20 client.15276 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc2f8e0 0x5570ee034db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 4 client.15276 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 --> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570edf90b60 con 0x5570edc2f8e0 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc2f8e0 0x5570ee034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7c9d7fa640 10 client.15276 ms_handle_connect on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.149+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc2f8e0 0x5570ee034db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26076b99ca35512d server_cookie=643ec644999c0c5f in_seq=0 out_seq=0 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2700913479 <== mds.2 v2:172.21.15.181:6838/76790251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570edf90b60 con 0x5570edc2f8e0 2024-09-21T07:06:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7c9d7fa640 10 client.15276 handle_command_reply: tid=0 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 client.15276 shutdown 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 msgr2=0x5570ee02e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7cac007090 tx=0x7f7cac0148c0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 shutdown_connections 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc2f8e0 0x5570ee034db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee02e9d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7c9d7fa640 0 client.15276 ms_handle_reset on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee022ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.150+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2700913479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee0229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.151+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 >> 172.21.15.28:0/2700913479 conn(0x5570edc65350 msgr2=0x5570ee01a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.151+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 shutdown_connections 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.151+0000 7f7cc2089740 1 -- 172.21.15.28:0/2700913479 wait complete. 2024-09-21T07:06:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.151+0000 7f7cc2089740 20 client.15276 trim_cache size 0 max 16384 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 Processor -- start 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 -- start start 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee034db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc70f60 0x5570ee02e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5570ee0330f0 con 0x5570edc50280 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5570ee0337c0 con 0x5570edc70f60 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cc2089740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570ee033e90 con 0x5570edc480a0 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cb90b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cb90b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50220/0 (socket says 172.21.15.28:50220) 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cb90b0640 1 -- 172.21.15.28:0/973753370 learned_addr learned my addr 172.21.15.28:0/973753370 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.169+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc70f60 0x5570ee02e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 -- 172.21.15.28:0/973753370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 msgr2=0x5570ee034db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee034db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 -- 172.21.15.28:0/973753370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc70f60 msgr2=0x5570ee02e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc70f60 0x5570ee02e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 -- 172.21.15.28:0/973753370 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ee019d60 con 0x5570edc50280 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee034db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7cb406aaa0 tx=0x7f7ca4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b604a937000cfef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7c9f7fe640 1 -- 172.21.15.28:0/973753370 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4035040 con 0x5570edc50280 2024-09-21T07:06:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7c9f7fe640 1 -- 172.21.15.28:0/973753370 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca40043f0 con 0x5570edc50280 2024-09-21T07:06:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.170+0000 7f7c9f7fe640 1 -- 172.21.15.28:0/973753370 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40035f0 con 0x5570edc50280 2024-09-21T07:06:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- 172.21.15.28:0/973753370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 msgr2=0x5570ee022980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7cb406aaa0 tx=0x7f7ca4031400 comp rx=0 tx=0).stop 2024-09-21T07:06:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- 172.21.15.28:0/973753370 shutdown_connections 2024-09-21T07:06:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc70f60 0x5570ee02e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc50280 0x5570ee022980 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 --2- 172.21.15.28:0/973753370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee034db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- 172.21.15.28:0/973753370 >> 172.21.15.28:0/973753370 conn(0x5570edc65350 msgr2=0x5570ee021020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- 172.21.15.28:0/973753370 shutdown_connections 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- 172.21.15.28:0/973753370 wait complete. 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 -- start start 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.171+0000 7f7cc2089740 1 Processor -- start 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee037110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee037650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5570ee034c30 con 0x5570edc70f60 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5570ee034560 con 0x5570edc50280 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5570ee035300 con 0x5570edc480a0 2024-09-21T07:06:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cc2089740 10 client.0 _ll_register_callbacks cb 0x7f7cb00ea830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50230/0 (socket says 172.21.15.28:50230) 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2788767626 learned_addr learned my addr 172.21.15.28:0/2788767626 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee037650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 msgr2=0x5570ee037110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee037110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2788767626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 msgr2=0x5570ee037650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee037650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.172+0000 7f7cba0b2640 1 -- 172.21.15.28:0/2788767626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ee00f080 con 0x5570edc70f60 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cba0b2640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0097c0 tx=0x7f7cac00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422a5dd7ce45b142 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac02b9a0 con 0x5570edc70f60 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7cac02bb40 con 0x5570edc70f60 2024-09-21T07:06:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca40043f0 con 0x5570edc70f60 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cac013590 con 0x5570edc70f60 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 10 client.15282 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5570ee0a0370 con 0x5570edc70f60 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca40043f0 con 0x5570edc70f60 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cac02e910 con 0x5570edc70f60 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 10 client.15282 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 10 client.15282 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 20 client.15282 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc04c90 0x5570ee0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 4 client.15282 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.173+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 --> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] -- command(tid 0: {"prefix": "status"}) -- 0x5570edf8c610 con 0x5570edc04c90 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc04c90 0x5570ee0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7cb90b0640 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc04c90 0x5570ee0a39b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a545acdfed9d4f78 server_cookie=4eedb3fff3d35f8f in_seq=0 out_seq=0 2024-09-21T07:06:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7c9d7fa640 10 client.15282 ms_handle_connect on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7c9d7fa640 1 -- 172.21.15.28:0/2788767626 <== mds.2 v2:172.21.15.181:6838/76790251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5570edf8c610 con 0x5570edc04c90 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7c9d7fa640 10 client.15282 handle_command_reply: tid=0 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.174+0000 7f7cc2089740 1 client.15282 shutdown 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 msgr2=0x5570ee037b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0097c0 tx=0x7f7cac00d040 comp rx=0 tx=0).stop 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 shutdown_connections 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:6838/76790251,v1:172.21.15.181:6839/76790251] conn(0x5570edc04c90 0x5570ee0a39b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5570edc70f60 0x5570ee037b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5570edc50280 0x5570ee037650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7c9d7fa640 0 client.15282 ms_handle_reset on v2:172.21.15.181:6838/76790251 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 --2- 172.21.15.28:0/2788767626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5570edc480a0 0x5570ee037110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 >> 172.21.15.28:0/2788767626 conn(0x5570edc65350 msgr2=0x5570ee017f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 shutdown_connections 2024-09-21T07:06:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 1 -- 172.21.15.28:0/2788767626 wait complete. 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cc2089740 20 client.15282 trim_cache size 0 max 16384 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24616, 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 92.834128903000007, 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:22.184 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 121.172252214 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 msgr2=0x7f7ca00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 0x7f7ca00b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5570ee015b80 tx=0x7f7cb00ea960 comp rx=0 tx=0).stop 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 msgr2=0x7f7cb40ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000d950 tx=0x7f7cb000de10 comp rx=0 tx=0).stop 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 shutdown_connections 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7ca00b6510 0x7f7ca00b8a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7cb4108cf0 0x7f7cb41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.175+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cb41083a0 0x7f7cb40ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.176+0000 7f7cbbb15640 1 --2- 172.21.15.28:0/1792723483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cb4102a60 0x7f7cb40ff670 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.176+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 >> 172.21.15.28:0/1792723483 conn(0x7f7cb4079730 msgr2=0x7f7cb41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.176+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 shutdown_connections 2024-09-21T07:06:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:22.176+0000 7f7cbbb15640 1 -- 172.21.15.28:0/1792723483 wait complete. 2024-09-21T07:06:23.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.a status 2024-09-21T07:06:23.347 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:23.780 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:23 smithi028 ceph-mon[31213]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:23.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:23 smithi129 ceph-mon[34863]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 -- 172.21.15.28:0/942921338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff750108cf0 msgr2=0x7ff75010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 --2- 172.21.15.28:0/942921338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff750108cf0 0x7ff75010f520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff748009ca0 tx=0x7ff74802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 -- 172.21.15.28:0/942921338 shutdown_connections 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 --2- 172.21.15.28:0/942921338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff750108cf0 0x7ff75010f520 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 --2- 172.21.15.28:0/942921338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7501083a0 0x7ff7501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 --2- 172.21.15.28:0/942921338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 0x7ff750102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 -- 172.21.15.28:0/942921338 >> 172.21.15.28:0/942921338 conn(0x7ff750079730 msgr2=0x7ff750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 -- 172.21.15.28:0/942921338 shutdown_connections 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.871+0000 7ff756727640 1 -- 172.21.15.28:0/942921338 wait complete. 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 Processor -- start 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 -- start start 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 0x7ff75019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 0x7ff75019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.872+0000 7ff756727640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff750112960 con 0x7ff7501083a0 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff756727640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff7501127e0 con 0x7ff750102a60 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff756727640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff750112ae0 con 0x7ff750108cf0 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42538/0 (socket says 172.21.15.28:42538) 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 -- 172.21.15.28:0/1248101703 learned_addr learned my addr 172.21.15.28:0/1248101703 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 0x7ff75019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 0x7ff75019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 -- 172.21.15.28:0/1248101703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 msgr2=0x7ff75019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 0x7ff75019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 -- 172.21.15.28:0/1248101703 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 msgr2=0x7ff75019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 0x7ff75019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 -- 172.21.15.28:0/1248101703 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7501a64c0 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 0x7ff75019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff747fff640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff738005fd0 tx=0x7ff73800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff74dffb640 1 -- 172.21.15.28:0/1248101703 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738017070 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7501a67b0 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff74dffb640 1 -- 172.21.15.28:0/1248101703 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff738009c30 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff74dffb640 1 -- 172.21.15.28:0/1248101703 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738003d30 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.873+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7501a6d40 con 0x7ff7501083a0 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 Processor -- start 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 -- start start 2024-09-21T07:06:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff74dffb640 1 -- 172.21.15.28:0/1248101703 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff738003ed0 con 0x7ff7501083a0 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ef1f60 0x564187297f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x564187298440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56418720fc10 con 0x564186ed1280 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5641871ff040 con 0x564186ef1f60 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564187202e50 con 0x564186ec90a0 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42544/0 (socket says 172.21.15.28:42544) 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff747fff640 1 -- 172.21.15.28:0/2735508561 learned_addr learned my addr 172.21.15.28:0/2735508561 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff754cc4640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ef1f60 0x564187297f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.876+0000 7ff74ffff640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x564187298440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 -- 172.21.15.28:0/2735508561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 msgr2=0x564187298440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x564187298440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 -- 172.21.15.28:0/2735508561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ef1f60 msgr2=0x564187297f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ef1f60 0x564187297f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 -- 172.21.15.28:0/2735508561 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564186f5d540 con 0x564186ed1280 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff74ffff640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x564187298440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff74dffb640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 0x7ff73c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff747fff640 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ef260 tx=0x7ff7380eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf5d7afcc9b2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 0x7ff73c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff7467fc640 1 -- 172.21.15.28:0/2735508561 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380a97f0 con 0x564186ed1280 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff7467fc640 1 -- 172.21.15.28:0/2735508561 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380accb0 con 0x564186ed1280 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff74dffb640 1 -- 172.21.15.28:0/1248101703 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff7380e7000 con 0x7ff7501083a0 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.877+0000 7ff7467fc640 1 -- 172.21.15.28:0/2735508561 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380b4b30 con 0x564186ed1280 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 -- 172.21.15.28:0/2735508561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 msgr2=0x564187298980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 0x7ff73c0b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff748004af0 tx=0x7ff748005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ef260 tx=0x7ff7380eaf90 comp rx=0 tx=0).stop 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 -- 172.21.15.28:0/2735508561 shutdown_connections 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x564187298980 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x564187298440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/2735508561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ef1f60 0x564187297f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 -- 172.21.15.28:0/2735508561 >> 172.21.15.28:0/2735508561 conn(0x564186ee6350 msgr2=0x564187295df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 -- 172.21.15.28:0/2735508561 shutdown_connections 2024-09-21T07:06:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.878+0000 7ff75cc9b740 1 -- 172.21.15.28:0/2735508561 wait complete. 2024-09-21T07:06:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 -- start start 2024-09-21T07:06:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 Processor -- start 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 0x5641872a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ef1f60 0x5641872af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5641870605f0 con 0x564186ed1280 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56418719a010 con 0x564186ec90a0 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5641872a66e0 con 0x564186ef1f60 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.879+0000 7ff75cc9b740 10 client.0 _ll_register_callbacks cb 0x5641871f9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42550/0 (socket says 172.21.15.28:42550) 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 -- 172.21.15.28:0/1243941539 learned_addr learned my addr 172.21.15.28:0/1243941539 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 0x5641872a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ef1f60 0x5641872af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 -- 172.21.15.28:0/1243941539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ef1f60 msgr2=0x5641872af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ef1f60 0x5641872af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 -- 172.21.15.28:0/1243941539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 msgr2=0x5641872a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 0x5641872a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 -- 172.21.15.28:0/1243941539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641871c7a00 con 0x564186ed1280 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 0x5641872a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff747fff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff7380acea0 tx=0x7ff7380ea8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd8c38818b9dac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff72f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380b4da0 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff738022da0 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7380accb0 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.880+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff7380abcb0 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 10 client.15294 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641872b2540 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380accb0 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff738061a70 con 0x564186ed1280 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 10 client.15294 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 10 client.15294 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 20 client.15294 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186eb08e0 0x5641872b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 4 client.15294 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 --> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564187211b60 con 0x564186eb08e0 2024-09-21T07:06:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.881+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186eb08e0 0x5641872b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.882+0000 7ff72f7fe640 10 client.15294 ms_handle_connect on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.882+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186eb08e0 0x5641872b5940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f6e3bca2675f7ddb server_cookie=a3be34d72a08004c in_seq=0 out_seq=0 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.882+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1243941539 <== mds.1 v2:172.21.15.28:6840/1067476795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564187211b60 con 0x564186eb08e0 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.882+0000 7ff72f7fe640 10 client.15294 handle_command_reply: tid=0 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.882+0000 7ff75cc9b740 1 client.15294 shutdown 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 msgr2=0x5641872a3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff7380acea0 tx=0x7ff7380ea8b0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 shutdown_connections 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186eb08e0 0x5641872b5940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ef1f60 0x5641872af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ed1280 0x5641872a3ee0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1243941539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ec90a0 0x5641872a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 >> 172.21.15.28:0/1243941539 conn(0x564186ee6350 msgr2=0x56418729b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff72f7fe640 0 client.15294 ms_handle_reset on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 shutdown_connections 2024-09-21T07:06:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1243941539 wait complete. 2024-09-21T07:06:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.883+0000 7ff75cc9b740 20 client.15294 trim_cache size 0 max 16384 2024-09-21T07:06:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 Processor -- start 2024-09-21T07:06:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 -- start start 2024-09-21T07:06:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.901+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5641872b3c80 con 0x564186ef1f60 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5641872b4350 con 0x564186ed1280 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5641872b4a20 con 0x564186ec90a0 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42558/0 (socket says 172.21.15.28:42558) 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 -- 172.21.15.28:0/3939018789 learned_addr learned my addr 172.21.15.28:0/3939018789 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff747fff640 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff74ffff640 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 -- 172.21.15.28:0/3939018789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 msgr2=0x5641872a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872a2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 -- 172.21.15.28:0/3939018789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 msgr2=0x5641872af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 -- 172.21.15.28:0/3939018789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641872a46f0 con 0x564186ef1f60 2024-09-21T07:06:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff754cc4640 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff748035000 tx=0x7ff748043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cea80f8fbdce1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff745ffb640 1 -- 172.21.15.28:0/3939018789 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748031820 con 0x564186ef1f60 2024-09-21T07:06:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff745ffb640 1 -- 172.21.15.28:0/3939018789 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff748036050 con 0x564186ef1f60 2024-09-21T07:06:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.902+0000 7ff745ffb640 1 -- 172.21.15.28:0/3939018789 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74802f9e0 con 0x564186ef1f60 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 -- 172.21.15.28:0/3939018789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 msgr2=0x5641872afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff748035000 tx=0x7ff748043000 comp rx=0 tx=0).stop 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 -- 172.21.15.28:0/3939018789 shutdown_connections 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872afe80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/3939018789 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 -- 172.21.15.28:0/3939018789 >> 172.21.15.28:0/3939018789 conn(0x564186ee6350 msgr2=0x56418729e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 -- 172.21.15.28:0/3939018789 shutdown_connections 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.903+0000 7ff75cc9b740 1 -- 172.21.15.28:0/3939018789 wait complete. 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 -- start start 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 Processor -- start 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5641872b57c0 con 0x564186ef1f60 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5641872b50f0 con 0x564186ed1280 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5641872b5e90 con 0x564186ec90a0 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff75cc9b740 10 client.0 _ll_register_callbacks cb 0x7ff7380f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff754cc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff754cc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42566/0 (socket says 172.21.15.28:42566) 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff754cc4640 1 -- 172.21.15.28:0/1944326007 learned_addr learned my addr 172.21.15.28:0/1944326007 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.904+0000 7ff747fff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 -- 172.21.15.28:0/1944326007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 msgr2=0x5641872b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 -- 172.21.15.28:0/1944326007 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 msgr2=0x5641872b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 -- 172.21.15.28:0/1944326007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564187323e40 con 0x564186ef1f60 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff747fff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff754cc4640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff74802a900 tx=0x7ff748009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959bfd4b91b73f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff72f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748059070 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff748004450 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.905+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff748036050 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff7480318e0 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 10 client.15300 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564187325090 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff748036050 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff748030890 con 0x564186ef1f60 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 10 client.15300 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 10 client.15300 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 20 client.15300 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186e85c90 0x564187328400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 4 client.15300 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 --> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] -- command(tid 0: {"prefix": "status"}) -- 0x56418720d610 con 0x564186e85c90 2024-09-21T07:06:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186e85c90 0x564187328400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.906+0000 7ff72f7fe640 10 client.15300 ms_handle_connect on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff74ffff640 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186e85c90 0x564187328400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a070dedea2aef994 server_cookie=fc04904d2f2d338c in_seq=0 out_seq=0 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff72f7fe640 1 -- 172.21.15.28:0/1944326007 <== mds.1 v2:172.21.15.28:6840/1067476795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56418720d610 con 0x564186e85c90 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff72f7fe640 10 client.15300 handle_command_reply: tid=0 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 client.15300 shutdown 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 msgr2=0x5641872b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff74802a900 tx=0x7ff748009a20 comp rx=0 tx=0).stop 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 shutdown_connections 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:6840/1067476795,v1:172.21.15.28:6841/1067476795] conn(0x564186e85c90 0x564187328400 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564186ef1f60 0x5641872b75c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564186ed1280 0x5641872b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 --2- 172.21.15.28:0/1944326007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564186ec90a0 0x5641872b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 >> 172.21.15.28:0/1944326007 conn(0x564186ee6350 msgr2=0x564187295600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff72f7fe640 0 client.15300 ms_handle_reset on v2:172.21.15.28:6840/1067476795 2024-09-21T07:06:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 shutdown_connections 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 1 -- 172.21.15.28:0/1944326007 wait complete. 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.907+0000 7ff75cc9b740 20 client.15300 trim_cache size 0 max 16384 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24623, 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 95.572748609000001, 2024-09-21T07:06:23.914 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 116.701695253 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 msgr2=0x7ff73c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 0x7ff73c0b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff748004af0 tx=0x7ff748005d80 comp rx=0 tx=0).stop 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 msgr2=0x7ff75019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff738005fd0 tx=0x7ff73800dde0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 shutdown_connections 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff73c0b6510 0x7ff73c0b8a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff750108cf0 0x7ff75019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7501083a0 0x7ff75019b6f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 --2- 172.21.15.28:0/1248101703 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff750102a60 0x7ff75019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 >> 172.21.15.28:0/1248101703 conn(0x7ff750079730 msgr2=0x7ff750104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 shutdown_connections 2024-09-21T07:06:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:23.908+0000 7ff756727640 1 -- 172.21.15.28:0/1248101703 wait complete. 2024-09-21T07:06:24.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:23 smithi181 ceph-mon[34686]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:06:24.683 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:06:24.941 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3801459344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae84102ae0 msgr2=0x7fae84102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3801459344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae84102ae0 0x7fae84102ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fae80009900 tx=0x7fae8002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3801459344 shutdown_connections 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3801459344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 0x7fae8410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3801459344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae841083d0 0x7fae841087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3801459344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae84102ae0 0x7fae84102ef0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.439+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3801459344 >> 172.21.15.28:0/3801459344 conn(0x7fae84079760 msgr2=0x7fae84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3801459344 shutdown_connections 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3801459344 wait complete. 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 Processor -- start 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 -- start start 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae84102ae0 0x7fae841993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.440+0000 7fae8b4b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae8b4b2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 0x7fae8419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae8b4b2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fae84112990 con 0x7fae841083d0 2024-09-21T07:06:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae8b4b2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fae84112810 con 0x7fae84102ae0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae8b4b2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae84112b10 con 0x7fae84108d20 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42576/0 (socket says 172.21.15.28:42576) 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 -- 172.21.15.28:0/3664655329 learned_addr learned my addr 172.21.15.28:0/3664655329 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae8924e640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae84102ae0 0x7fae841993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 0x7fae8419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 -- 172.21.15.28:0/3664655329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 msgr2=0x7fae8419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 0x7fae8419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 -- 172.21.15.28:0/3664655329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae84102ae0 msgr2=0x7fae841993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae84102ae0 0x7fae841993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 -- 172.21.15.28:0/3664655329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8419f270 con 0x7fae841083d0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c970 tx=0x7fae7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae7a7fc640 1 -- 172.21.15.28:0/3664655329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74014070 con 0x7fae841083d0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.441+0000 7fae7a7fc640 1 -- 172.21.15.28:0/3664655329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae74004440 con 0x7fae841083d0 2024-09-21T07:06:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.442+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8419f560 con 0x7fae841083d0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.442+0000 7fae7a7fc640 1 -- 172.21.15.28:0/3664655329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74003e50 con 0x7fae841083d0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.442+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841a5d80 con 0x7fae841083d0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.444+0000 7fae91a26740 1 Processor -- start 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 -- start start 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae7a7fc640 1 -- 172.21.15.28:0/3664655329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fae74017070 con 0x7fae841083d0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04c5f60 0x5600a086bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a086c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5600a07e3c10 con 0x5600a04a5280 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5600a07d3040 con 0x5600a049d0a0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae91a26740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5600a07d6e50 con 0x5600a04c5f60 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42578/0 (socket says 172.21.15.28:42578) 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 -- 172.21.15.28:0/3955510247 learned_addr learned my addr 172.21.15.28:0/3955510247 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04c5f60 0x5600a086bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae8924e640 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a086c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 -- 172.21.15.28:0/3955510247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04c5f60 msgr2=0x5600a086bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04c5f60 0x5600a086bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 -- 172.21.15.28:0/3955510247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 msgr2=0x5600a086c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a086c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.445+0000 7fae88a4d640 1 -- 172.21.15.28:0/3955510247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a0531540 con 0x5600a04a5280 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae7a7fc640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 0x7fae700b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae740eaf10 tx=0x7fae740ed840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf8ba219d28853 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 0x7fae700b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae7a7fc640 1 -- 172.21.15.28:0/3664655329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fae740e6df0 con 0x7fae841083d0 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae6f7fe640 1 -- 172.21.15.28:0/3955510247 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740a95e0 con 0x5600a04a5280 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae6f7fe640 1 -- 172.21.15.28:0/3955510247 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae740acaa0 con 0x5600a04a5280 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.446+0000 7fae6f7fe640 1 -- 172.21.15.28:0/3955510247 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740ac700 con 0x5600a04a5280 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 -- 172.21.15.28:0/3955510247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 msgr2=0x5600a086c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 0x7fae700b8bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae7c008e40 tx=0x7fae7c0085f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae740eaf10 tx=0x7fae740ed840 comp rx=0 tx=0).stop 2024-09-21T07:06:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 -- 172.21.15.28:0/3955510247 shutdown_connections 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a086c980 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a086c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 --2- 172.21.15.28:0/3955510247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04c5f60 0x5600a086bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 -- 172.21.15.28:0/3955510247 >> 172.21.15.28:0/3955510247 conn(0x5600a04ba350 msgr2=0x5600a0869df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 -- 172.21.15.28:0/3955510247 shutdown_connections 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.447+0000 7fae91a26740 1 -- 172.21.15.28:0/3955510247 wait complete. 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.448+0000 7fae91a26740 1 -- start start 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.448+0000 7fae91a26740 1 Processor -- start 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.448+0000 7fae91a26740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a049d0a0 0x5600a0879bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a04c5f60 0x5600a0885b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5600a06345f0 con 0x5600a04a5280 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5600a076e010 con 0x5600a04c5f60 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5600a087c7e0 con 0x5600a049d0a0 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 10 client.0 _ll_register_callbacks cb 0x5600a07cd340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42584/0 (socket says 172.21.15.28:42584) 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 -- 172.21.15.28:0/684042093 learned_addr learned my addr 172.21.15.28:0/684042093 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae8924e640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a049d0a0 0x5600a0879bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae89a4f640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a04c5f60 0x5600a0885b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 -- 172.21.15.28:0/684042093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a049d0a0 msgr2=0x5600a0879bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a049d0a0 0x5600a0879bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 -- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a04c5f60 msgr2=0x5600a0885b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a04c5f60 0x5600a0885b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 -- 172.21.15.28:0/684042093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a079ba00 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae88a4d640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae740e4950 tx=0x7fae7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dd287f3daac1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740ac8e0 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae740acaa0 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.449+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fae740ed110 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fae740acd60 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 10 client.15312 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600a0888720 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae740acaa0 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fae7405c1f0 con 0x5600a04a5280 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 10 client.15312 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 10 client.15312 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 20 client.15312 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04848e0 0x5600a088bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 4 client.15312 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:06:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 --> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600a07e5b60 con 0x5600a04848e0 2024-09-21T07:06:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.450+0000 7fae8924e640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04848e0 0x5600a088bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.451+0000 7fae6cff9640 10 client.15312 ms_handle_connect on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.451+0000 7fae8924e640 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04848e0 0x5600a088bd40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5f0da6b5770ad server_cookie=99fedca0ee94930b in_seq=0 out_seq=0 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae6cff9640 1 -- 172.21.15.28:0/684042093 <== mds.0 v2:172.21.15.129:6838/903226333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600a07e5b60 con 0x5600a04848e0 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae6cff9640 10 client.15312 handle_command_reply: tid=0 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 client.15312 shutdown 2024-09-21T07:06:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 msgr2=0x5600a087a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fae740e4950 tx=0x7fae7400cf60 comp rx=0 tx=0).stop 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 shutdown_connections 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a04c5f60 0x5600a0885b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04848e0 0x5600a088bd40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae6cff9640 0 client.15312 ms_handle_reset on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04a5280 0x5600a087a130 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 --2- 172.21.15.28:0/684042093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a049d0a0 0x5600a0879bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 >> 172.21.15.28:0/684042093 conn(0x5600a04ba350 msgr2=0x5600a086d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 shutdown_connections 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 1 -- 172.21.15.28:0/684042093 wait complete. 2024-09-21T07:06:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.452+0000 7fae91a26740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T07:06:25.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.470+0000 7fae91a26740 1 Processor -- start 2024-09-21T07:06:25.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.470+0000 7fae91a26740 1 -- start start 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a0885fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0869750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5600a088a080 con 0x5600a04848e0 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5600a088a750 con 0x5600a049d0a0 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae91a26740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5600a088ae20 con 0x5600a04a5280 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42588/0 (socket says 172.21.15.28:42588) 2024-09-21T07:06:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 -- 172.21.15.28:0/3074933470 learned_addr learned my addr 172.21.15.28:0/3074933470 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a0885fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0869750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 -- 172.21.15.28:0/3074933470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 msgr2=0x5600a0869750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0869750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 -- 172.21.15.28:0/3074933470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 msgr2=0x5600a0885fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a0885fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 -- 172.21.15.28:0/3074933470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a087acb0 con 0x5600a04848e0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae89a4f640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0869750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae88a4d640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a0885fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae8924e640 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fae80009900 tx=0x7fae80031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cb233ec1c483dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae6effd640 1 -- 172.21.15.28:0/3074933470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80035040 con 0x5600a04848e0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae6effd640 1 -- 172.21.15.28:0/3074933470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae80004430 con 0x5600a04848e0 2024-09-21T07:06:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.471+0000 7fae6effd640 1 -- 172.21.15.28:0/3074933470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae800035f0 con 0x5600a04848e0 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 -- 172.21.15.28:0/3074933470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 msgr2=0x5600a0885a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fae80009900 tx=0x7fae80031bc0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 -- 172.21.15.28:0/3074933470 shutdown_connections 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0869750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a0885fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 --2- 172.21.15.28:0/3074933470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a0885a80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 -- 172.21.15.28:0/3074933470 >> 172.21.15.28:0/3074933470 conn(0x5600a04ba350 msgr2=0x5600a0874ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 -- 172.21.15.28:0/3074933470 shutdown_connections 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.472+0000 7fae91a26740 1 -- 172.21.15.28:0/3074933470 wait complete. 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 -- start start 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 Processor -- start 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a08726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0872c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5600a088bbc0 con 0x5600a04848e0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5600a088b4f0 con 0x5600a049d0a0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5600a088c290 con 0x5600a04a5280 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae91a26740 10 client.0 _ll_register_callbacks cb 0x7fae80009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae8924e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae8924e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42598/0 (socket says 172.21.15.28:42598) 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae8924e640 1 -- 172.21.15.28:0/2229956222 learned_addr learned my addr 172.21.15.28:0/2229956222 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.473+0000 7fae88a4d640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a08726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 -- 172.21.15.28:0/2229956222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 msgr2=0x5600a0872c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0872c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 -- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 msgr2=0x5600a08726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a08726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 -- 172.21.15.28:0/2229956222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a0893f90 con 0x5600a04848e0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae8924e640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fae80004400 tx=0x7fae800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6668e6ca486dc5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:25.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80035040 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fae80004ec0 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae80004430 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fae800048a0 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae91a26740 10 client.15318 fetch_fsmap learned FSMap version 24 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.474+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600a08f9760 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae80004430 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fae80003d00 con 0x5600a04848e0 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 10 client.15318 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 10 client.15318 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 20 client.15318 populate_metadata read hostname 'smithi028' 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04c5f60 0x5600a08fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 4 client.15318 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 --> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] -- command(tid 0: {"prefix": "status"}) -- 0x5600a07e1610 con 0x5600a04c5f60 2024-09-21T07:06:25.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.475+0000 7fae88a4d640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04c5f60 0x5600a08fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae88a4d640 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04c5f60 0x5600a08fcc20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3c755f2d8a2cc6 server_cookie=233b2d3e7742b701 in_seq=0 out_seq=0 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae6cff9640 10 client.15318 ms_handle_connect on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae6cff9640 1 -- 172.21.15.28:0/2229956222 <== mds.0 v2:172.21.15.129:6838/903226333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5600a07e1610 con 0x5600a04c5f60 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae6cff9640 10 client.15318 handle_command_reply: tid=0 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 client.15318 shutdown 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 msgr2=0x5600a08721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fae80004400 tx=0x7fae800045e0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 shutdown_connections 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600a04a5280 0x5600a0872c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5600a049d0a0 0x5600a08726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.129:6838/903226333,v1:172.21.15.129:6839/903226333] conn(0x5600a04c5f60 0x5600a08fcc20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 --2- 172.21.15.28:0/2229956222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5600a04848e0 0x5600a08721a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae6cff9640 0 client.15318 ms_handle_reset on v2:172.21.15.129:6838/903226333 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 >> 172.21.15.28:0/2229956222 conn(0x5600a04ba350 msgr2=0x5600a0869600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 shutdown_connections 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 1 -- 172.21.15.28:0/2229956222 wait complete. 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.476+0000 7fae91a26740 20 client.15318 trim_cache size 0 max 16384 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "7b450f7c-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24635, 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 104.414250948, 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 24, 2024-09-21T07:06:25.483 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 74, 2024-09-21T07:06:25.484 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 72, 2024-09-21T07:06:25.484 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 115.596503187 2024-09-21T07:06:25.484 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:06:25.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 msgr2=0x7fae700b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 0x7fae700b8bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae7c008e40 tx=0x7fae7c0085f0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 msgr2=0x7fae84199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c970 tx=0x7fae7400ce30 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 shutdown_connections 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fae700b66e0 0x7fae700b8bf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae84108d20 0x7fae8419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae841083d0 0x7fae84199960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 --2- 172.21.15.28:0/3664655329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae84102ae0 0x7fae841993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 >> 172.21.15.28:0/3664655329 conn(0x7fae84079760 msgr2=0x7fae841014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 shutdown_connections 2024-09-21T07:06:25.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:25.477+0000 7fae8b4b2640 1 -- 172.21.15.28:0/3664655329 wait complete. 2024-09-21T07:06:25.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:25 smithi028 ceph-mon[31213]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:25.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:25 smithi129 ceph-mon[34863]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:26.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:25 smithi181 ceph-mon[34686]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:06:26.408 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:06:26.432 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:06:26.432 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T07:06:26.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:26.432 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-21T07:06:26.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:26.451 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-09-21T07:06:26.523 INFO:teuthology.orchestra.run.smithi028.stderr:Cannot find device "ceph-brx" 2024-09-21T07:06:26.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:06:26.525 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T07:06:26.525 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:06:26.525 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:26.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:06:26.826 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- 172.21.15.28:0/3537219150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56501094a0 msgr2=0x7f56501098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 --2- 172.21.15.28:0/3537219150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56501094a0 0x7f56501098b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5644009900 tx=0x7f564402a410 comp rx=0 tx=0).stop 2024-09-21T07:06:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- 172.21.15.28:0/3537219150 shutdown_connections 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 --2- 172.21.15.28:0/3537219150 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5650109df0 0x7f5650110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 --2- 172.21.15.28:0/3537219150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56501094a0 0x7f56501098b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 --2- 172.21.15.28:0/3537219150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 0x7f5650103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- 172.21.15.28:0/3537219150 >> 172.21.15.28:0/3537219150 conn(0x7f565007b850 msgr2=0x7f565007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- 172.21.15.28:0/3537219150 shutdown_connections 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- 172.21.15.28:0/3537219150 wait complete. 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 Processor -- start 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.308+0000 7f5657c0d640 1 -- start start 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 0x7f565019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56501094a0 0x7f565019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113ab0 con 0x7f5650109df0 2024-09-21T07:06:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113930 con 0x7f56501094a0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f5657c0d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113c30 con 0x7f5650103b60 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42622/0 (socket says 172.21.15.28:42622) 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 -- 172.21.15.28:0/522645126 learned_addr learned my addr 172.21.15.28:0/522645126 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56559a9640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 0x7f565019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56551a8640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56501094a0 0x7f565019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 -- 172.21.15.28:0/522645126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 msgr2=0x7f565019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 0x7f565019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 -- 172.21.15.28:0/522645126 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56501094a0 msgr2=0x7f565019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56501094a0 0x7f565019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 -- 172.21.15.28:0/522645126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56501a04d0 con 0x7f5650109df0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.309+0000 7f56561aa640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f564800eb10 tx=0x7f564800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.310+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648004b20 con 0x7f5650109df0 2024-09-21T07:06:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.310+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5648004cc0 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.310+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56501a07c0 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.310+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648010670 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.310+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56501a6f20 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.311+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5650103f70 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.312+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5648005000 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.313+0000 7f5642ffd640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 0x7f563c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.313+0000 7f56559a9640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 0x7f563c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.313+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f56480e7ad0 con 0x7f5650109df0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.314+0000 7f56559a9640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 0x7f563c0b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f564c005d00 tx=0x7f564c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.316+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5648056710 con 0x7f5650109df0 2024-09-21T07:06:27.549 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:06:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.546+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f565019b690 con 0x7f5650109df0 2024-09-21T07:06:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.546+0000 7f5642ffd640 1 -- 172.21.15.28:0/522645126 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f565019b690 con 0x7f5650109df0 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.548+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 msgr2=0x7f563c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.548+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 0x7f563c0b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f564c005d00 tx=0x7f564c00b410 comp rx=0 tx=0).stop 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.548+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 msgr2=0x7f565019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.548+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f564800eb10 tx=0x7f564800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 shutdown_connections 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f563c0b6510 0x7f563c0b8a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5650109df0 0x7f565019fda0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f56501094a0 0x7f565019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 --2- 172.21.15.28:0/522645126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5650103b60 0x7f565019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 >> 172.21.15.28:0/522645126 conn(0x7f565007b850 msgr2=0x7f56501075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 shutdown_connections 2024-09-21T07:06:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:27.549+0000 7f5657c0d640 1 -- 172.21.15.28:0/522645126 wait complete. 2024-09-21T07:06:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:27 smithi129 ceph-mon[34863]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:27 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/522645126' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:06:27.922 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:27 smithi028 ceph-mon[31213]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:27.922 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:27 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/522645126' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:06:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:27 smithi181 ceph-mon[34686]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:27 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/522645126' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:06:28.270 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:06:28.271 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:06:28.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:28.271 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-21T07:06:28.289 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42172sec preferred_lft 42172sec 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-21T07:06:28.290 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-21T07:06:28.290 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:06:28.291 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-21T07:06:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:28.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:28.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:28.507 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:06:28.532 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-21T07:06:28.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:28.534 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-21T07:06:28.609 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-21T07:06:28.609 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:06:28.609 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:06:28.609 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:06:28.609 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:06:28.609 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:06:28.610 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-21T07:06:28.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:06:28.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:06:28.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:06:28.610 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-21T07:06:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:28.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:28.903 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-21T07:06:28.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:28.920 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-09-21T07:06:28.977 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:06:28.977 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-21T07:06:28.977 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:06:28.977 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:06:28.977 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-21T07:06:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.097 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:06:29.097 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:06:29.097 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-21T07:06:29.097 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:06:29.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:06:29.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:06:29.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:06:29.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:06:29.098 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-21T07:06:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:29.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.229 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:06:29.229 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-21T07:06:29.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-21T07:06:29.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:06:29.229 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-21T07:06:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:29.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:06:29.308 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:29.325 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:06:29.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:06:29.325 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:29.381 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T07:06:29.381 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T07:06:29.381 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/da8e04a1-d48f-49df-ad7f-1b4c7bfe8732 2024-09-21T07:06:29.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:29.382 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/da8e04a1-d48f-49df-ad7f-1b4c7bfe8732 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T07:06:29.490 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T07:06:29.490 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T07:06:29.630 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T07:06:29.630 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T07:06:29.630 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.129:3300,172.21.15.181:3300" 2024-09-21T07:06:29.630 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@7b450f7c-77e6-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/da8e04a1-d48f-49df-ad7f-1b4c7bfe8732 2024-09-21T07:06:29.630 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.28:3300/172.21.15.129:3300/172.21.15.181:3300" will pass to kernel 2024-09-21T07:06:29.631 INFO:teuthology.orchestra.run.smithi028.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:06:29.631 INFO:teuthology.orchestra.run.smithi028.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:06:29.631 INFO:teuthology.orchestra.run.smithi028.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:06:29.631 INFO:teuthology.orchestra.run.smithi028.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:06:29.631 INFO:teuthology.orchestra.run.smithi028.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:06:29.632 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:06:29.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:06:29.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:29.663 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:06:29.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:06:29.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.762 INFO:teuthology.orchestra.run.smithi028.stdout:client25055 2024-09-21T07:06:29.762 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T07:06:29.762 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:06:29.780 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:06:29.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:29 smithi028 ceph-mon[31213]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:29.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:29 smithi181 ceph-mon[34686]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:06:29.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.854 INFO:teuthology.orchestra.run.smithi028.stdout:client25055 2024-09-21T07:06:29.855 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:06:29.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:29 smithi129 ceph-mon[34863]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:29.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:06:29.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.912 INFO:teuthology.orchestra.run.smithi028.stdout:client25055 2024-09-21T07:06:29.912 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490.client25055/status') 2024-09-21T07:06:29.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:06:29.972 INFO:teuthology.orchestra.run.smithi028.stdout:instance: client.25055 (3)172.21.15.28:0/905633989 2024-09-21T07:06:29.972 INFO:teuthology.orchestra.run.smithi028.stdout:blocklisted: false 2024-09-21T07:06:29.972 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records in 2024-09-21T07:06:29.972 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records out 2024-09-21T07:06:29.972 INFO:teuthology.orchestra.run.smithi028.stderr:70 bytes copied, 2.3869e-05 s, 2.9 MB/s 2024-09-21T07:06:29.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:06:29.979 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:06:29.992 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:06:29.992 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T07:06:29.992 DEBUG:teuthology.orchestra.run.smithi028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 -- 172.21.15.28:0/2841550019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed2006c320 msgr2=0x7fed20108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 --2- 172.21.15.28:0/2841550019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed2006c320 0x7fed20108700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009900 tx=0x7fed1c02a410 comp rx=0 tx=0).stop 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 -- 172.21.15.28:0/2841550019 shutdown_connections 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 --2- 172.21.15.28:0/2841550019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2010b620 0x7fed2010db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 --2- 172.21.15.28:0/2841550019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed20108c40 0x7fed2010b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 --2- 172.21.15.28:0/2841550019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed2006c320 0x7fed20108700 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 -- 172.21.15.28:0/2841550019 >> 172.21.15.28:0/2841550019 conn(0x7fed200fdf00 msgr2=0x7fed201003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 -- 172.21.15.28:0/2841550019 shutdown_connections 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 -- 172.21.15.28:0/2841550019 wait complete. 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.105+0000 7fed27758640 1 Processor -- start 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 -- start start 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2006c320 0x7fed2019c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 0x7fed2019d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111500 con 0x7fed20108c40 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111380 con 0x7fed2010b620 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed27758640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111680 con 0x7fed2006c320 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42636/0 (socket says 172.21.15.28:42636) 2024-09-21T07:06:30.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 -- 172.21.15.28:0/4279559645 learned_addr learned my addr 172.21.15.28:0/4279559645 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed254f4640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2006c320 0x7fed2019c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 -- 172.21.15.28:0/4279559645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2006c320 msgr2=0x7fed2019c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2006c320 0x7fed2019c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed25cf5640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 0x7fed2019d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 -- 172.21.15.28:0/4279559645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 msgr2=0x7fed2019d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 0x7fed2019d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 -- 172.21.15.28:0/4279559645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2019db70 con 0x7fed20108c40 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed25cf5640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 0x7fed2019d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.106+0000 7fed24cf3640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d950 tx=0x7fed1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.107+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10017030 con 0x7fed20108c40 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.107+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2019de60 con 0x7fed20108c40 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.107+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10004020 con 0x7fed20108c40 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.107+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100047a0 con 0x7fed20108c40 2024-09-21T07:06:30.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.107+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201a4550 con 0x7fed20108c40 2024-09-21T07:06:30.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.108+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed200ffa20 con 0x7fed20108c40 2024-09-21T07:06:30.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.109+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fed10009a30 con 0x7fed20108c40 2024-09-21T07:06:30.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.110+0000 7fed167fc640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 0x7fed0c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.110+0000 7fed254f4640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 0x7fed0c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.110+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fed100e6e50 con 0x7fed20108c40 2024-09-21T07:06:30.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.111+0000 7fed254f4640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 0x7fed0c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fed1c000c00 tx=0x7fed1c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:30.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.114+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed100ad690 con 0x7fed20108c40 2024-09-21T07:06:30.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.345+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fed2002e640 con 0x7fed20108c40 2024-09-21T07:06:30.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.559+0000 7fed167fc640 1 -- 172.21.15.28:0/4279559645 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fed100b1a70 con 0x7fed20108c40 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 msgr2=0x7fed0c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 0x7fed0c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fed1c000c00 tx=0x7fed1c031400 comp rx=0 tx=0).stop 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 msgr2=0x7fed2019c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fed1000d950 tx=0x7fed1000de10 comp rx=0 tx=0).stop 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 shutdown_connections 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed0c0b6510 0x7fed0c0b8a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed2010b620 0x7fed2019d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed20108c40 0x7fed2019c7a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 --2- 172.21.15.28:0/4279559645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed2006c320 0x7fed2019c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 >> 172.21.15.28:0/4279559645 conn(0x7fed200fdf00 msgr2=0x7fed20109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 shutdown_connections 2024-09-21T07:06:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.562+0000 7fed27758640 1 -- 172.21.15.28:0/4279559645 wait complete. 2024-09-21T07:06:30.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T07:06:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.690+0000 7f6cd5263640 1 -- 172.21.15.28:0/3021280919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 msgr2=0x7f6cd0104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.690+0000 7f6cd5263640 1 --2- 172.21.15.28:0/3021280919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd0104b60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009900 tx=0x7f6cb802a410 comp rx=0 tx=0).stop 2024-09-21T07:06:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 -- 172.21.15.28:0/3021280919 shutdown_connections 2024-09-21T07:06:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 --2- 172.21.15.28:0/3021280919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 0x7f6cd010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 --2- 172.21.15.28:0/3021280919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd0104b60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 --2- 172.21.15.28:0/3021280919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 0x7f6cd0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 -- 172.21.15.28:0/3021280919 >> 172.21.15.28:0/3021280919 conn(0x7f6cd00ff030 msgr2=0x7f6cd01014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 -- 172.21.15.28:0/3021280919 shutdown_connections 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 -- 172.21.15.28:0/3021280919 wait complete. 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 Processor -- start 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 -- start start 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 0x7f6cd019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.691+0000 7f6cd5263640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cd5263640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 0x7f6cd019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cd5263640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010f350 con 0x7f6cd0104750 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cd5263640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010f1d0 con 0x7f6cd01036d0 2024-09-21T07:06:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cd5263640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010f4d0 con 0x7f6cd01050f0 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42648/0 (socket says 172.21.15.28:42648) 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 -- 172.21.15.28:0/1951249289 learned_addr learned my addr 172.21.15.28:0/1951249289 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cceffd640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 0x7f6cd019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6ccf7fe640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 0x7f6cd019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 -- 172.21.15.28:0/1951249289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 msgr2=0x7f6cd019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 0x7f6cd019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 -- 172.21.15.28:0/1951249289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 msgr2=0x7f6cd019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 0x7f6cd019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 -- 172.21.15.28:0/1951249289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd019b940 con 0x7f6cd0104750 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cc7fff640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8031440 tx=0x7f6cb8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb803f070 con 0x7f6cd0104750 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd019bbd0 con 0x7f6cd0104750 2024-09-21T07:06:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb8031c50 con 0x7f6cd0104750 2024-09-21T07:06:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.692+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8035030 con 0x7f6cd0104750 2024-09-21T07:06:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.693+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01a21d0 con 0x7f6cd0104750 2024-09-21T07:06:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.693+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd010a8a0 con 0x7f6cd0104750 2024-09-21T07:06:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.695+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6cb8042070 con 0x7f6cd0104750 2024-09-21T07:06:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.696+0000 7f6cccff9640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 0x7f6cbc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.696+0000 7f6cceffd640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 0x7f6cbc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.696+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6cb8108350 con 0x7f6cd0104750 2024-09-21T07:06:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.696+0000 7f6cceffd640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 0x7f6cbc0b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0005d00 tx=0x7f6cc000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.699+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cb80ceb90 con 0x7f6cd0104750 2024-09-21T07:06:30.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:06:30.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:30 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:06:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.917+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 --> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f6cd00638a0 con 0x7f6cbc0b6510 2024-09-21T07:06:30.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.936+0000 7f6cccff9640 1 -- 172.21.15.28:0/1951249289 <== mgr.14152 v2:172.21.15.28:6800/2420223587 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f6cd00638a0 con 0x7f6cbc0b6510 2024-09-21T07:06:30.938 INFO:teuthology.orchestra.run.smithi028.stdout:{} 2024-09-21T07:06:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 msgr2=0x7f6cbc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 0x7f6cbc0b8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0005d00 tx=0x7f6cc000b410 comp rx=0 tx=0).stop 2024-09-21T07:06:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 msgr2=0x7f6cd019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8031440 tx=0x7f6cb8003c10 comp rx=0 tx=0).stop 2024-09-21T07:06:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 shutdown_connections 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f6cbc0b6510 0x7f6cbc0b8a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd01050f0 0x7f6cd019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cd0104750 0x7f6cd019a670 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 --2- 172.21.15.28:0/1951249289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6cd01036d0 0x7f6cd019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 >> 172.21.15.28:0/1951249289 conn(0x7f6cd00ff030 msgr2=0x7f6cd0107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 shutdown_connections 2024-09-21T07:06:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:06:30.939+0000 7f6cd5263640 1 -- 172.21.15.28:0/1951249289 wait complete. 2024-09-21T07:06:30.952 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:06:30.964 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T07:06:30.984 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:06:30.985 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T07:06:30.985 INFO:tasks.workunit:timeout=3h 2024-09-21T07:06:30.985 INFO:tasks.workunit:cleanup=True 2024-09-21T07:06:30.985 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:31.002 INFO:teuthology.orchestra.run.smithi028.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:31.002 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-21 07:04:59.485784565 +0000 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-21 07:04:59.485784565 +0000 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-21 07:06:29.655662937 +0000 2024-09-21T07:06:31.003 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-21 07:04:59.485784565 +0000 2024-09-21T07:06:31.003 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T07:06:31.003 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T07:06:31.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:30 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:06:31.078 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:06:31.135 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T07:06:31.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:06:30.923+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:06:31.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:06:30.923+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:06:31.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:06:30.923+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:06:31.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:06:30.923+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:06:31.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:06:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:06:30.923+0000 7f8978452640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:06:31.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:31 smithi129 ceph-mon[34863]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:31.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:31 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:06:31.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:31 smithi129 ceph-mon[34863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:06:31.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:31 smithi129 ceph-mon[34863]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:32.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:31 smithi181 ceph-mon[34686]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:32.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:31 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:06:32.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:31 smithi181 ceph-mon[34686]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:06:32.020 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:31 smithi181 ceph-mon[34686]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:32.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:31 smithi028 ceph-mon[31213]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:06:32.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:31 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4279559645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:06:32.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:31 smithi028 ceph-mon[31213]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:06:32.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:31 smithi028 ceph-mon[31213]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:33.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:33 smithi129 ceph-mon[34863]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:33.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:33 smithi129 ceph-mon[34863]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:06:34.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:33 smithi181 ceph-mon[34686]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:34.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:33 smithi181 ceph-mon[34686]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:06:34.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:33 smithi028 ceph-mon[31213]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:34.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:33 smithi028 ceph-mon[31213]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:06:35.849 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:35 smithi028 ceph-mon[31213]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-21T07:06:35.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:35 smithi129 ceph-mon[34863]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-21T07:06:36.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:35 smithi181 ceph-mon[34686]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-21T07:06:37.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:37 smithi129 ceph-mon[34863]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:38.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:37 smithi181 ceph-mon[34686]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:38.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:37 smithi028 ceph-mon[31213]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:39.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:39 smithi129 ceph-mon[34863]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-21T07:06:40.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:39 smithi181 ceph-mon[34686]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-21T07:06:40.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:39 smithi028 ceph-mon[31213]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-21T07:06:41.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:41 smithi129 ceph-mon[34863]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:06:42.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:41 smithi181 ceph-mon[34686]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:06:42.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:41 smithi028 ceph-mon[31213]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:06:43.858 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:43 smithi129 ceph-mon[34863]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:43 smithi181 ceph-mon[34686]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:44.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:43 smithi028 ceph-mon[31213]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-21T07:06:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:45 smithi129 ceph-mon[34863]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:06:46.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:45 smithi181 ceph-mon[34686]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:06:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:45 smithi028 ceph-mon[31213]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:06:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:47 smithi129 ceph-mon[34863]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T07:06:48.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:47 smithi181 ceph-mon[34686]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T07:06:48.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:47 smithi028 ceph-mon[31213]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T07:06:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:49 smithi028 ceph-mon[31213]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:49.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:49 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:49 smithi129 ceph-mon[34863]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:49 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:49 smithi181 ceph-mon[34686]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:49 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:51.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:51.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:51.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:51.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:51.607 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:51.608 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:06:53.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:53 smithi129 ceph-mon[34863]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:53 smithi181 ceph-mon[34686]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:53.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:53 smithi028 ceph-mon[31213]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T07:06:55.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:55 smithi129 ceph-mon[34863]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T07:06:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:55 smithi181 ceph-mon[34686]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T07:06:55.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:55 smithi028 ceph-mon[31213]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T07:06:57.606 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:57 smithi129 ceph-mon[34863]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:57 smithi181 ceph-mon[34686]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:57.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:57 smithi028 ceph-mon[31213]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:06:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:06:59 smithi181 ceph-mon[34686]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:59.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:06:59 smithi028 ceph-mon[31213]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:06:59.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:06:59 smithi129 ceph-mon[34863]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:01 smithi181 ceph-mon[34686]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:01.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:01 smithi028 ceph-mon[31213]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:01.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:01 smithi129 ceph-mon[34863]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:03 smithi181 ceph-mon[34686]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:03.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:03 smithi028 ceph-mon[31213]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:03.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:03 smithi129 ceph-mon[34863]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:05 smithi181 ceph-mon[34686]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:05.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:05 smithi028 ceph-mon[31213]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:05.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:05 smithi129 ceph-mon[34863]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:07 smithi181 ceph-mon[34686]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:07:07.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:07 smithi028 ceph-mon[31213]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:07:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:07 smithi129 ceph-mon[34863]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:07:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:09 smithi181 ceph-mon[34686]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:09.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:09 smithi028 ceph-mon[31213]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:09 smithi129 ceph-mon[34863]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:11.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:11 smithi181 ceph-mon[34686]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:11.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:11 smithi028 ceph-mon[31213]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:11.864 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:11 smithi129 ceph-mon[34863]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:13.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:13 smithi181 ceph-mon[34686]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:13.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:13 smithi028 ceph-mon[31213]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:13.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:13 smithi129 ceph-mon[34863]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:07:15.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:15 smithi181 ceph-mon[34686]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:15.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:15 smithi028 ceph-mon[31213]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:15.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:15 smithi129 ceph-mon[34863]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:07:17.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:17 smithi181 ceph-mon[34686]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:17.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:17 smithi028 ceph-mon[31213]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:17.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:17 smithi129 ceph-mon[34863]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:19.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:19 smithi181 ceph-mon[34686]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:19.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:19 smithi028 ceph-mon[31213]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:19.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:19 smithi129 ceph-mon[34863]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:21.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:21 smithi181 ceph-mon[34686]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:21.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:21 smithi028 ceph-mon[31213]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:21.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:21 smithi129 ceph-mon[34863]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:23.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:23 smithi181 ceph-mon[34686]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:23.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:23 smithi028 ceph-mon[31213]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:23.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:23 smithi129 ceph-mon[34863]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:25.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:25 smithi181 ceph-mon[34686]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:25.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:25 smithi028 ceph-mon[31213]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:25.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:25 smithi129 ceph-mon[34863]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:27.659 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:27 smithi129 ceph-mon[34863]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:27.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:27 smithi181 ceph-mon[34686]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:27.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:27 smithi028 ceph-mon[31213]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:29.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:29 smithi181 ceph-mon[34686]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:29.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:29 smithi028 ceph-mon[31213]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:29.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:29 smithi129 ceph-mon[34863]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:07:31.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:31 smithi181 ceph-mon[34686]: pgmap v373: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:31.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:31 smithi028 ceph-mon[31213]: pgmap v373: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:31.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:31 smithi129 ceph-mon[34863]: pgmap v373: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T07:07:31.924 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 91% (11608/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T07:07:32.843 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-21T07:07:32.844 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.845 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T07:07:32.845 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:32.845 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:07:32.848 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T07:07:32.917 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T07:07:32.919 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:07:32.919 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T07:07:33.595 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T07:07:33.666 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T07:07:33.708 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:07:33.709 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:07:33.709 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T07:07:33.750 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:07:33.753 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T07:07:33.753 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T07:07:33.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:33 smithi181 ceph-mon[34686]: pgmap v374: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:33.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:33 smithi028 ceph-mon[31213]: pgmap v374: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:33.811 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-21T07:07:33.813 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-21T07:07:33.813 DEBUG:teuthology.orchestra.run.smithi028:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T07:07:33.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:33 smithi129 ceph-mon[34863]: pgmap v374: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:07:33.873 INFO:tasks.workunit.client.0.smithi028.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-21T07:07:33.892 INFO:tasks.workunit.client.0.smithi028.stderr:--2024-09-21 07:07:33-- http://download.ceph.com/qa/fsync-tester.c 2024-09-21T07:07:33.902 INFO:tasks.workunit.client.0.smithi028.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T07:07:33.923 INFO:tasks.workunit.client.0.smithi028.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T07:07:33.944 INFO:tasks.workunit.client.0.smithi028.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T07:07:33.944 INFO:tasks.workunit.client.0.smithi028.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-21T07:07:33.945 INFO:tasks.workunit.client.0.smithi028.stderr:Saving to: ‘fsync-tester.c’ 2024-09-21T07:07:33.948 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:33.948 INFO:tasks.workunit.client.0.smithi028.stderr: 0K .. 100% 530M=0s 2024-09-21T07:07:33.949 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:33.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-21 07:07:33 (530 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-21T07:07:33.949 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-21T07:07:33.949 INFO:tasks.workunit.client.0.smithi028.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-21T07:07:34.041 INFO:tasks.workunit.client.0.smithi028.stderr:+ ./fsync-tester 2024-09-21T07:07:35.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:35 smithi181 ceph-mon[34686]: pgmap v375: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:35.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:35 smithi028 ceph-mon[31213]: pgmap v375: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:35.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:35 smithi129 ceph-mon[34863]: pgmap v375: 97 pgs: 97 active+clean; 664 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:07:37.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:37 smithi181 ceph-mon[34686]: pgmap v376: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:37.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:37 smithi028 ceph-mon[31213]: pgmap v376: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:37.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:37 smithi129 ceph-mon[34863]: pgmap v376: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:39.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:39 smithi181 ceph-mon[34686]: pgmap v377: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:39.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:39 smithi028 ceph-mon[31213]: pgmap v377: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:39.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:39 smithi129 ceph-mon[34863]: pgmap v377: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 KiB/s wr, 5 op/s 2024-09-21T07:07:41.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:41 smithi181 ceph-mon[34686]: pgmap v378: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 177 KiB/s wr, 9 op/s 2024-09-21T07:07:41.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:41 smithi028 ceph-mon[31213]: pgmap v378: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 177 KiB/s wr, 9 op/s 2024-09-21T07:07:41.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:41 smithi129 ceph-mon[34863]: pgmap v378: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 177 KiB/s wr, 9 op/s 2024-09-21T07:07:43.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:43 smithi181 ceph-mon[34686]: pgmap v379: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 604 KiB/s wr, 8 op/s 2024-09-21T07:07:43.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:43 smithi028 ceph-mon[31213]: pgmap v379: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 604 KiB/s wr, 8 op/s 2024-09-21T07:07:43.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:43 smithi129 ceph-mon[34863]: pgmap v379: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 604 KiB/s wr, 8 op/s 2024-09-21T07:07:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:45 smithi181 ceph-mon[34686]: pgmap v380: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 607 KiB/s wr, 10 op/s 2024-09-21T07:07:45.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:45 smithi181 ceph-mon[34686]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:07:45.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:45 smithi028 ceph-mon[31213]: pgmap v380: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 607 KiB/s wr, 10 op/s 2024-09-21T07:07:45.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:45 smithi028 ceph-mon[31213]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:07:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:45 smithi129 ceph-mon[34863]: pgmap v380: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 607 KiB/s wr, 10 op/s 2024-09-21T07:07:45.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:45 smithi129 ceph-mon[34863]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:07:47.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:47 smithi181 ceph-mon[34686]: pgmap v381: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T07:07:47.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:47 smithi028 ceph-mon[31213]: pgmap v381: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T07:07:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:47 smithi129 ceph-mon[34863]: pgmap v381: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-21T07:07:49.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:49 smithi181 ceph-mon[34686]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 863 KiB/s wr, 9 op/s 2024-09-21T07:07:49.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:49 smithi028 ceph-mon[31213]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 863 KiB/s wr, 9 op/s 2024-09-21T07:07:49.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:49 smithi129 ceph-mon[34863]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 863 KiB/s wr, 9 op/s 2024-09-21T07:07:51.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:51.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:51.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:51.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:52.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:52.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:07:53.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:53 smithi181 ceph-mon[34686]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T07:07:53.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:53 smithi028 ceph-mon[31213]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T07:07:53.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:53 smithi129 ceph-mon[34863]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T07:07:55.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:55 smithi181 ceph-mon[34686]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:07:55.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:55 smithi028 ceph-mon[31213]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:07:55.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:55 smithi129 ceph-mon[34863]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:07:57.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:57 smithi181 ceph-mon[34686]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:07:57.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:57 smithi028 ceph-mon[31213]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:07:57.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:57 smithi129 ceph-mon[34863]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:07:59.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:07:59 smithi181 ceph-mon[34686]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:07:59.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:07:59 smithi028 ceph-mon[31213]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:07:59.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:07:59 smithi129 ceph-mon[34863]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:08:01.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:01 smithi181 ceph-mon[34686]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:01.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:01 smithi028 ceph-mon[31213]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:01.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:01 smithi129 ceph-mon[34863]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:03.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:03 smithi181 ceph-mon[34686]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:03.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:03 smithi028 ceph-mon[31213]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:03.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:03 smithi129 ceph-mon[34863]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:05.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:05 smithi181 ceph-mon[34686]: pgmap v390: 97 pgs: 97 active+clean; 1.9 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 863 KiB/s wr, 10 op/s 2024-09-21T07:08:05.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:05 smithi028 ceph-mon[31213]: pgmap v390: 97 pgs: 97 active+clean; 1.9 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 863 KiB/s wr, 10 op/s 2024-09-21T07:08:05.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:05 smithi129 ceph-mon[34863]: pgmap v390: 97 pgs: 97 active+clean; 1.9 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 863 KiB/s wr, 10 op/s 2024-09-21T07:08:07.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:07 smithi181 ceph-mon[34686]: pgmap v391: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-09-21T07:08:07.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:07 smithi028 ceph-mon[31213]: pgmap v391: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-09-21T07:08:07.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:07 smithi129 ceph-mon[34863]: pgmap v391: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-09-21T07:08:09.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:09 smithi181 ceph-mon[34686]: pgmap v392: 97 pgs: 97 active+clean; 50 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 8 op/s 2024-09-21T07:08:09.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:09 smithi028 ceph-mon[31213]: pgmap v392: 97 pgs: 97 active+clean; 50 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 8 op/s 2024-09-21T07:08:09.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:09 smithi129 ceph-mon[34863]: pgmap v392: 97 pgs: 97 active+clean; 50 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 8 op/s 2024-09-21T07:08:11.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:11 smithi181 ceph-mon[34686]: pgmap v393: 97 pgs: 97 active+clean; 182 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 14 op/s 2024-09-21T07:08:11.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:11 smithi028 ceph-mon[31213]: pgmap v393: 97 pgs: 97 active+clean; 182 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 14 op/s 2024-09-21T07:08:11.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:11 smithi129 ceph-mon[34863]: pgmap v393: 97 pgs: 97 active+clean; 182 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 14 op/s 2024-09-21T07:08:13.770 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:13 smithi181 ceph-mon[34686]: pgmap v394: 97 pgs: 97 active+clean; 190 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 19 MiB/s wr, 13 op/s 2024-09-21T07:08:13.798 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:13 smithi028 ceph-mon[31213]: pgmap v394: 97 pgs: 97 active+clean; 190 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 19 MiB/s wr, 13 op/s 2024-09-21T07:08:13.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:13 smithi129 ceph-mon[34863]: pgmap v394: 97 pgs: 97 active+clean; 190 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 19 MiB/s wr, 13 op/s 2024-09-21T07:08:15.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:15 smithi181 ceph-mon[34686]: pgmap v395: 97 pgs: 97 active+clean; 222 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:15.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:15 smithi028 ceph-mon[31213]: pgmap v395: 97 pgs: 97 active+clean; 222 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:15.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:15 smithi129 ceph-mon[34863]: pgmap v395: 97 pgs: 97 active+clean; 222 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:17.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:17 smithi181 ceph-mon[34686]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 31 MiB/s wr, 16 op/s 2024-09-21T07:08:17.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:17 smithi028 ceph-mon[31213]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 31 MiB/s wr, 16 op/s 2024-09-21T07:08:17.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:17 smithi129 ceph-mon[34863]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 31 MiB/s wr, 16 op/s 2024-09-21T07:08:19.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:19 smithi181 ceph-mon[34686]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 29 MiB/s wr, 15 op/s 2024-09-21T07:08:19.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:19 smithi028 ceph-mon[31213]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 29 MiB/s wr, 15 op/s 2024-09-21T07:08:19.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:19 smithi129 ceph-mon[34863]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 29 MiB/s wr, 15 op/s 2024-09-21T07:08:21.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:21 smithi181 ceph-mon[34686]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:21.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:21 smithi028 ceph-mon[31213]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:21.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:21 smithi129 ceph-mon[34863]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 17 op/s 2024-09-21T07:08:23.769 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:23 smithi181 ceph-mon[34686]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:23.797 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:23 smithi028 ceph-mon[31213]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:23.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:23 smithi129 ceph-mon[34863]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:25.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:25 smithi129 ceph-mon[34863]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 13 op/s 2024-09-21T07:08:26.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:25 smithi181 ceph-mon[34686]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 13 op/s 2024-09-21T07:08:26.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:25 smithi028 ceph-mon[31213]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 13 op/s 2024-09-21T07:08:27.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:27 smithi129 ceph-mon[34863]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 9 op/s 2024-09-21T07:08:28.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:27 smithi181 ceph-mon[34686]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 9 op/s 2024-09-21T07:08:28.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:27 smithi028 ceph-mon[31213]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 9 op/s 2024-09-21T07:08:29.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:29 smithi181 ceph-mon[34686]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:08:29.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:29 smithi129 ceph-mon[34863]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:08:30.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:29 smithi028 ceph-mon[31213]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 859 KiB/s wr, 7 op/s 2024-09-21T07:08:31.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:31 smithi129 ceph-mon[34863]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:32.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:31 smithi181 ceph-mon[34686]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:32.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:31 smithi028 ceph-mon[31213]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:33.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:33 smithi129 ceph-mon[34863]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:34.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:33 smithi181 ceph-mon[34686]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:34.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:33 smithi028 ceph-mon[31213]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-21T07:08:34.491 INFO:tasks.workunit.client.0.smithi028.stdout:setting up random write file 2024-09-21T07:08:34.491 INFO:tasks.workunit.client.0.smithi028.stdout:done setting up random write file 2024-09-21T07:08:34.491 INFO:tasks.workunit.client.0.smithi028.stdout:starting fsync run 2024-09-21T07:08:34.491 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0094s 2024-09-21T07:08:34.491 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.492 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0048s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0039s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0043s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0040s 2024-09-21T07:08:34.493 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0039s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0065s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0062s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0059s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0060s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0003s fsync time: 0.0043s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-21T07:08:34.494 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0048s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-21T07:08:34.495 INFO:tasks.workunit.client.0.smithi028.stdout:run done 61 fsyncs total, killing random writer 2024-09-21T07:08:34.496 INFO:tasks.workunit.client.0.smithi028.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T07:08:34.496 INFO:tasks.workunit.client.0.smithi028.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T07:08:34.496 INFO:tasks.workunit.client.0.smithi028.stderr:+ whereis lsof 2024-09-21T07:08:34.532 INFO:tasks.workunit.client.0.smithi028.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-21T07:08:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ lsof 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7d27d4d876aa7e876a3841b71108e9e5b2cd027dc667b821897d46694bfac072/merged 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/cf594dbdf6645f10b8f749ffa1b5706d360fa9cb2fbf08fcac3bdebb855a8777/merged 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2966368f1a78b7beed1024254573c618f83bbcd08b6e3ad52175f7ea627c79a6/merged 2024-09-21T07:08:34.545 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.550 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/288d9ca7354f6f069e8e043b4b780436a8ae88ba89f16115e5029e6e85418552/merged 2024-09-21T07:08:34.550 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/464803ad89e3608fb0cf2d45e338815cbea735912ea05481024164059338a828/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/6820dd8b61284ee4a692b95ed4080a950dba6b09fb137972f878e8eb6fb46000/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/89c820f51520a5985f5ada3bd0309e8dabd2175d74212db9f91d094300f6d421/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/5359cb13173089b336164b3dc811bba95f5f2c2992dd37c9835d373500c86453/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/bebb65eca789778456e59e9204f6fb3659e5262a0e713b826bdd4a8897712878/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b4bb85e1b16e92ecce281ace6127fb35608ee52a63bc68fb74c676f7a41dc8d5/merged 2024-09-21T07:08:34.551 INFO:tasks.workunit.client.0.smithi028.stderr: Output information may be incomplete. 2024-09-21T07:08:34.609 INFO:tasks.workunit.client.0.smithi028.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-21T07:08:34.610 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-21T07:08:34.611 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-21T07:08:34.612 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-21T07:08:34.613 INFO:tasks.workunit.client.0.smithi028.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-21T07:08:34.614 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-21T07:08:34.615 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-21T07:08:34.616 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-21T07:08:34.617 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-21T07:08:34.618 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-21T07:08:34.619 INFO:tasks.workunit.client.0.smithi028.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-21T07:08:34.620 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-21T07:08:34.621 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-09-21T07:08:34.622 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-21T07:08:34.623 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-21T07:08:34.624 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-21T07:08:34.625 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-21T07:08:34.626 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-21T07:08:34.627 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-21T07:08:34.628 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-21T07:08:34.629 INFO:tasks.workunit.client.0.smithi028.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kswapd0 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kswapd0 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kswapd0 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kswapd0 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 100 root cwd unknown /proc/100/cwd (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 100 root rtd unknown /proc/100/root (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 100 root txt unknown /proc/100/exe (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 100 root NOFD /proc/100/fd (opendir: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-21T07:08:34.630 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-21T07:08:34.631 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 125 root cwd unknown /proc/125/cwd (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 125 root rtd unknown /proc/125/root (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 125 root txt unknown /proc/125/exe (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 125 root NOFD /proc/125/fd (opendir: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-09-21T07:08:34.632 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 278 root cwd unknown /proc/278/cwd (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 278 root rtd unknown /proc/278/root (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 278 root txt unknown /proc/278/exe (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 278 root NOFD /proc/278/fd (opendir: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 284 root cwd unknown /proc/284/cwd (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 284 root rtd unknown /proc/284/root (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 284 root txt unknown /proc/284/exe (readlink: Permission denied) 2024-09-21T07:08:34.633 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 284 root NOFD /proc/284/fd (opendir: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 291 root cwd unknown /proc/291/cwd (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 291 root rtd unknown /proc/291/root (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 291 root txt unknown /proc/291/exe (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 291 root NOFD /proc/291/fd (opendir: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 294 root cwd unknown /proc/294/cwd (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 294 root rtd unknown /proc/294/root (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 294 root txt unknown /proc/294/exe (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 294 root NOFD /proc/294/fd (opendir: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 298 root cwd unknown /proc/298/cwd (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 298 root rtd unknown /proc/298/root (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 298 root txt unknown /proc/298/exe (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 298 root NOFD /proc/298/fd (opendir: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 324 root cwd unknown /proc/324/cwd (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 324 root rtd unknown /proc/324/root (readlink: Permission denied) 2024-09-21T07:08:34.634 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 324 root txt unknown /proc/324/exe (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 324 root NOFD /proc/324/fd (opendir: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 435 root cwd unknown /proc/435/cwd (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 435 root rtd unknown /proc/435/root (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 435 root txt unknown /proc/435/exe (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 435 root NOFD /proc/435/fd (opendir: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 436 root cwd unknown /proc/436/cwd (readlink: Permission denied) 2024-09-21T07:08:34.635 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 436 root rtd unknown /proc/436/root (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 436 root txt unknown /proc/436/exe (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 436 root NOFD /proc/436/fd (opendir: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 438 root cwd unknown /proc/438/cwd (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 438 root rtd unknown /proc/438/root (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 438 root txt unknown /proc/438/exe (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 438 root NOFD /proc/438/fd (opendir: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_0 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_0 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_0 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-21T07:08:34.636 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_0 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_1 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_1 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_1 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_1 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_2 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_2 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-21T07:08:34.637 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_2 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_2 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_3 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_3 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_3 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_3 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_4 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-21T07:08:34.638 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_4 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_4 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_4 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_5 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_5 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_5 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_5 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-21T07:08:34.639 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_6 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_6 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_6 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_6 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_7 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_7 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_7 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_7 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-21T07:08:34.640 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_8 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_8 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_8 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_8 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_9 471 root cwd unknown /proc/471/cwd (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_9 471 root rtd unknown /proc/471/root (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_9 471 root txt unknown /proc/471/exe (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:scsi_eh_9 471 root NOFD /proc/471/fd (opendir: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 472 root cwd unknown /proc/472/cwd (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 472 root rtd unknown /proc/472/root (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 472 root txt unknown /proc/472/exe (readlink: Permission denied) 2024-09-21T07:08:34.641 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 472 root NOFD /proc/472/fd (opendir: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 474 root cwd unknown /proc/474/cwd (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 474 root rtd unknown /proc/474/root (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 474 root txt unknown /proc/474/exe (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 474 root NOFD /proc/474/fd (opendir: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 478 root cwd unknown /proc/478/cwd (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 478 root rtd unknown /proc/478/root (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 478 root txt unknown /proc/478/exe (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 478 root NOFD /proc/478/fd (opendir: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:jbd2/sda1 502 root cwd unknown /proc/502/cwd (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:jbd2/sda1 502 root rtd unknown /proc/502/root (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:jbd2/sda1 502 root txt unknown /proc/502/exe (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:jbd2/sda1 502 root NOFD /proc/502/fd (opendir: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 503 root cwd unknown /proc/503/cwd (readlink: Permission denied) 2024-09-21T07:08:34.642 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 503 root rtd unknown /proc/503/root (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 503 root txt unknown /proc/503/exe (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 503 root NOFD /proc/503/fd (opendir: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 532 root cwd unknown /proc/532/cwd (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 532 root rtd unknown /proc/532/root (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 532 root txt unknown /proc/532/exe (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 532 root NOFD /proc/532/fd (opendir: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-j 580 root cwd unknown /proc/580/cwd (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-j 580 root rtd unknown /proc/580/root (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-j 580 root txt unknown /proc/580/exe (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-j 580 root NOFD /proc/580/fd (opendir: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:ext4lazyi 586 root cwd unknown /proc/586/cwd (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:ext4lazyi 586 root rtd unknown /proc/586/root (readlink: Permission denied) 2024-09-21T07:08:34.643 INFO:tasks.workunit.client.0.smithi028.stdout:ext4lazyi 586 root txt unknown /proc/586/exe (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:ext4lazyi 586 root NOFD /proc/586/fd (opendir: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-u 595 root cwd unknown /proc/595/cwd (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-u 595 root rtd unknown /proc/595/root (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-u 595 root txt unknown /proc/595/exe (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-u 595 root NOFD /proc/595/fd (opendir: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 644 root cwd unknown /proc/644/cwd (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 644 root rtd unknown /proc/644/root (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 644 root txt unknown /proc/644/exe (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 644 root NOFD /proc/644/fd (opendir: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kipmi0 658 root cwd unknown /proc/658/cwd (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kipmi0 658 root rtd unknown /proc/658/root (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kipmi0 658 root txt unknown /proc/658/exe (readlink: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:kipmi0 658 root NOFD /proc/658/fd (opendir: Permission denied) 2024-09-21T07:08:34.644 INFO:tasks.workunit.client.0.smithi028.stdout:rpcbind 666 rpc cwd unknown /proc/666/cwd (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:rpcbind 666 rpc rtd unknown /proc/666/root (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:rpcbind 666 rpc txt unknown /proc/666/exe (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:rpcbind 666 rpc NOFD /proc/666/fd (opendir: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 672 root cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 672 root rtd unknown /proc/672/root (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 672 root txt unknown /proc/672/exe (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 672 root NOFD /proc/672/fd (opendir: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 673 root cwd unknown /proc/673/cwd (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 673 root rtd unknown /proc/673/root (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 673 root txt unknown /proc/673/exe (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 673 root NOFD /proc/673/fd (opendir: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-21T07:08:34.645 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 675 auditd root cwd unknown /proc/674/task/675/cwd (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 675 auditd root rtd unknown /proc/674/task/675/root (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 675 auditd root txt unknown /proc/674/task/675/exe (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 675 auditd root NOFD /proc/674/task/675/fd (opendir: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 677 auditd root cwd unknown /proc/674/task/677/cwd (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 677 auditd root rtd unknown /proc/674/task/677/root (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 677 auditd root txt unknown /proc/674/task/677/exe (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:auditd 674 677 auditd root NOFD /proc/674/task/677/fd (opendir: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:sedispatc 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:sedispatc 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:sedispatc 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:sedispatc 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-21T07:08:34.646 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 720 dbus cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 720 dbus rtd unknown /proc/720/root (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 720 dbus txt unknown /proc/720/exe (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 720 dbus NOFD /proc/720/fd (opendir: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 721 dbus cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 721 dbus rtd unknown /proc/721/root (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 721 dbus txt unknown /proc/721/exe (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:dbus-brok 721 dbus NOFD /proc/721/fd (opendir: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 root cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 root rtd unknown /proc/722/root (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 root txt unknown /proc/722/exe (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 root NOFD /proc/722/fd (opendir: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 739 gmain root cwd unknown /proc/722/task/739/cwd (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 739 gmain root rtd unknown /proc/722/task/739/root (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 739 gmain root txt unknown /proc/722/task/739/exe (readlink: Permission denied) 2024-09-21T07:08:34.647 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 739 gmain root NOFD /proc/722/task/739/fd (opendir: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 740 gdbus root cwd unknown /proc/722/task/740/cwd (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 740 gdbus root rtd unknown /proc/722/task/740/root (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 740 gdbus root txt unknown /proc/722/task/740/exe (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:NetworkMa 722 740 gdbus root NOFD /proc/722/task/740/fd (opendir: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 root NOFD /proc/725/fd (opendir: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 732 gmain root cwd unknown /proc/725/task/732/cwd (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 732 gmain root rtd unknown /proc/725/task/732/root (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 732 gmain root txt unknown /proc/725/task/732/exe (readlink: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:irqbalanc 725 732 gmain root NOFD /proc/725/task/732/fd (opendir: Permission denied) 2024-09-21T07:08:34.648 INFO:tasks.workunit.client.0.smithi028.stdout:lsmd 726 libstoragemgmt cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:lsmd 726 libstoragemgmt rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:lsmd 726 libstoragemgmt txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:lsmd 726 libstoragemgmt NOFD /proc/726/fd (opendir: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:mcelog 727 root cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:mcelog 727 root rtd unknown /proc/727/root (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:mcelog 727 root txt unknown /proc/727/exe (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:mcelog 727 root NOFD /proc/727/fd (opendir: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:smartd 729 root cwd unknown /proc/729/cwd (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:smartd 729 root rtd unknown /proc/729/root (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:smartd 729 root txt unknown /proc/729/exe (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:smartd 729 root NOFD /proc/729/fd (opendir: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-l 731 root cwd unknown /proc/731/cwd (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-l 731 root rtd unknown /proc/731/root (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-l 731 root txt unknown /proc/731/exe (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:systemd-l 731 root NOFD /proc/731/fd (opendir: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 774 root cwd unknown /proc/774/cwd (readlink: Permission denied) 2024-09-21T07:08:34.649 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 774 root rtd unknown /proc/774/root (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 774 root txt unknown /proc/774/exe (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 774 root NOFD /proc/774/fd (opendir: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 root cwd unknown /proc/778/cwd (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 root rtd unknown /proc/778/root (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 root txt unknown /proc/778/exe (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 root NOFD /proc/778/fd (opendir: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 779 gssproxy root cwd unknown /proc/778/task/779/cwd (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 779 gssproxy root rtd unknown /proc/778/task/779/root (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 779 gssproxy root txt unknown /proc/778/task/779/exe (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 779 gssproxy root NOFD /proc/778/task/779/fd (opendir: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 780 gssproxy root cwd unknown /proc/778/task/780/cwd (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 780 gssproxy root rtd unknown /proc/778/task/780/root (readlink: Permission denied) 2024-09-21T07:08:34.650 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 780 gssproxy root txt unknown /proc/778/task/780/exe (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 780 gssproxy root NOFD /proc/778/task/780/fd (opendir: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 781 gssproxy root cwd unknown /proc/778/task/781/cwd (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 781 gssproxy root rtd unknown /proc/778/task/781/root (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 781 gssproxy root txt unknown /proc/778/task/781/exe (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 781 gssproxy root NOFD /proc/778/task/781/fd (opendir: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 782 gssproxy root cwd unknown /proc/778/task/782/cwd (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 782 gssproxy root rtd unknown /proc/778/task/782/root (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 782 gssproxy root txt unknown /proc/778/task/782/exe (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 782 gssproxy root NOFD /proc/778/task/782/fd (opendir: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 783 gssproxy root cwd unknown /proc/778/task/783/cwd (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 783 gssproxy root rtd unknown /proc/778/task/783/root (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 783 gssproxy root txt unknown /proc/778/task/783/exe (readlink: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:gssproxy 778 783 gssproxy root NOFD /proc/778/task/783/fd (opendir: Permission denied) 2024-09-21T07:08:34.651 INFO:tasks.workunit.client.0.smithi028.stdout:atd 785 root cwd unknown /proc/785/cwd (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:atd 785 root rtd unknown /proc/785/root (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:atd 785 root txt unknown /proc/785/exe (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:atd 785 root NOFD /proc/785/fd (opendir: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:crond 786 root cwd unknown /proc/786/cwd (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:crond 786 root rtd unknown /proc/786/root (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:crond 786 root txt unknown /proc/786/exe (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:crond 786 root NOFD /proc/786/fd (opendir: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:nrpe 812 nrpe cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:nrpe 812 nrpe rtd unknown /proc/812/root (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:nrpe 812 nrpe txt unknown /proc/812/exe (readlink: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:nrpe 812 nrpe NOFD /proc/812/fd (opendir: Permission denied) 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu cwd DIR 8,1 4096 2 / 2024-09-21T07:08:34.652 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-21T07:08:34.653 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-21T07:08:34.654 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 1u unix 0x0000000000000000 0t0 19791 type=STREAM (CONNECTED) 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 2u unix 0x0000000000000000 0t0 19791 type=STREAM (CONNECTED) 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 3u unix 0x0000000000000000 0t0 19819 type=DGRAM (CONNECTED) 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 4u a_inode 0,14 0 1080 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 5u a_inode 0,14 0 1080 [signalfd] 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 6r a_inode 0,14 0 1080 inotify 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 7r DIR 0,25 0 3232 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 8u a_inode 0,14 0 1080 [timerfd] 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 9u a_inode 0,14 0 1080 [eventpoll:10,13] 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 10r REG 0,20 0 19808 /proc/1008/mountinfo 2024-09-21T07:08:34.655 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 11r a_inode 0,14 0 1080 inotify 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 12u unix 0x0000000000000000 0t0 20797 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 13r a_inode 0,14 0 1080 inotify 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 15u netlink 0t0 19823 KOBJECT_UEVENT 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 16u unix 0x0000000000000000 0t0 23047 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 17u unix 0x0000000000000000 0t0 23048 type=DGRAM (CONNECTED) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 18u unix 0x0000000000000000 0t0 23049 type=DGRAM (CONNECTED) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 19u unix 0x0000000000000000 0t0 23050 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 20u unix 0x0000000000000000 0t0 23052 type=STREAM (CONNECTED) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 1008 ubuntu 21u a_inode 0,14 0 1080 [timerfd] 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 1010 ubuntu cwd unknown /proc/1010/cwd (readlink: Permission denied) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 1010 ubuntu rtd unknown /proc/1010/root (readlink: Permission denied) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 1010 ubuntu txt unknown /proc/1010/exe (readlink: Permission denied) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 1010 ubuntu NOFD /proc/1010/fd (opendir: Permission denied) 2024-09-21T07:08:34.656 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1242 root cwd unknown /proc/1242/cwd (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1242 root rtd unknown /proc/1242/root (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1242 root txt unknown /proc/1242/exe (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1242 root NOFD /proc/1242/fd (opendir: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1244 root cwd unknown /proc/1244/cwd (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1244 root rtd unknown /proc/1244/root (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1244 root txt unknown /proc/1244/exe (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:agetty 1244 root NOFD /proc/1244/fd (opendir: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 root cwd unknown /proc/2974/cwd (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 root rtd unknown /proc/2974/root (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 root txt unknown /proc/2974/exe (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 root NOFD /proc/2974/fd (opendir: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2988 in:imjour root cwd unknown /proc/2974/task/2988/cwd (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2988 in:imjour root rtd unknown /proc/2974/task/2988/root (readlink: Permission denied) 2024-09-21T07:08:34.657 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2988 in:imjour root txt unknown /proc/2974/task/2988/exe (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2988 in:imjour root NOFD /proc/2974/task/2988/fd (opendir: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2989 rs:main root cwd unknown /proc/2974/task/2989/cwd (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2989 rs:main root rtd unknown /proc/2974/task/2989/root (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2989 rs:main root txt unknown /proc/2974/task/2989/exe (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:rsyslogd 2974 2989 rs:main root NOFD /proc/2974/task/2989/fd (opendir: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 18664 root cwd unknown /proc/18664/cwd (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 18664 root rtd unknown /proc/18664/root (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 18664 root txt unknown /proc/18664/exe (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 18664 root NOFD /proc/18664/fd (opendir: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 polkitd cwd unknown /proc/19227/cwd (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 polkitd rtd unknown /proc/19227/root (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 polkitd txt unknown /proc/19227/exe (readlink: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 polkitd NOFD /proc/19227/fd (opendir: Permission denied) 2024-09-21T07:08:34.658 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19229 gmain polkitd cwd unknown /proc/19227/task/19229/cwd (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19229 gmain polkitd rtd unknown /proc/19227/task/19229/root (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19229 gmain polkitd txt unknown /proc/19227/task/19229/exe (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19229 gmain polkitd NOFD /proc/19227/task/19229/fd (opendir: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19230 gdbus polkitd cwd unknown /proc/19227/task/19230/cwd (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19230 gdbus polkitd rtd unknown /proc/19227/task/19230/root (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19230 gdbus polkitd txt unknown /proc/19227/task/19230/exe (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19230 gdbus polkitd NOFD /proc/19227/task/19230/fd (opendir: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19231 JS\x20Hel polkitd cwd unknown /proc/19227/task/19231/cwd (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19231 JS\x20Hel polkitd rtd unknown /proc/19227/task/19231/root (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19231 JS\x20Hel polkitd txt unknown /proc/19227/task/19231/exe (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19231 JS\x20Hel polkitd NOFD /proc/19227/task/19231/fd (opendir: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19232 JS\x20Hel polkitd cwd unknown /proc/19227/task/19232/cwd (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19232 JS\x20Hel polkitd rtd unknown /proc/19227/task/19232/root (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19232 JS\x20Hel polkitd txt unknown /proc/19227/task/19232/exe (readlink: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19232 JS\x20Hel polkitd NOFD /proc/19227/task/19232/fd (opendir: Permission denied) 2024-09-21T07:08:34.659 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19233 JS\x20Hel polkitd cwd unknown /proc/19227/task/19233/cwd (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19233 JS\x20Hel polkitd rtd unknown /proc/19227/task/19233/root (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19233 JS\x20Hel polkitd txt unknown /proc/19227/task/19233/exe (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19233 JS\x20Hel polkitd NOFD /proc/19227/task/19233/fd (opendir: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19234 JS\x20Hel polkitd cwd unknown /proc/19227/task/19234/cwd (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19234 JS\x20Hel polkitd rtd unknown /proc/19227/task/19234/root (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19234 JS\x20Hel polkitd txt unknown /proc/19227/task/19234/exe (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19234 JS\x20Hel polkitd NOFD /proc/19227/task/19234/fd (opendir: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19235 JS\x20Hel polkitd cwd unknown /proc/19227/task/19235/cwd (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19235 JS\x20Hel polkitd rtd unknown /proc/19227/task/19235/root (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19235 JS\x20Hel polkitd txt unknown /proc/19227/task/19235/exe (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19235 JS\x20Hel polkitd NOFD /proc/19227/task/19235/fd (opendir: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19236 JS\x20Hel polkitd cwd unknown /proc/19227/task/19236/cwd (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19236 JS\x20Hel polkitd rtd unknown /proc/19227/task/19236/root (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19236 JS\x20Hel polkitd txt unknown /proc/19227/task/19236/exe (readlink: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19236 JS\x20Hel polkitd NOFD /proc/19227/task/19236/fd (opendir: Permission denied) 2024-09-21T07:08:34.660 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19237 JS\x20Hel polkitd cwd unknown /proc/19227/task/19237/cwd (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19237 JS\x20Hel polkitd rtd unknown /proc/19227/task/19237/root (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19237 JS\x20Hel polkitd txt unknown /proc/19227/task/19237/exe (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19237 JS\x20Hel polkitd NOFD /proc/19227/task/19237/fd (opendir: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19238 JS\x20Hel polkitd cwd unknown /proc/19227/task/19238/cwd (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19238 JS\x20Hel polkitd rtd unknown /proc/19227/task/19238/root (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19238 JS\x20Hel polkitd txt unknown /proc/19227/task/19238/exe (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19238 JS\x20Hel polkitd NOFD /proc/19227/task/19238/fd (opendir: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19239 polkitd polkitd cwd unknown /proc/19227/task/19239/cwd (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19239 polkitd polkitd rtd unknown /proc/19227/task/19239/root (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19239 polkitd polkitd txt unknown /proc/19227/task/19239/exe (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:polkitd 19227 19239 polkitd polkitd NOFD /proc/19227/task/19239/fd (opendir: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21134 root cwd unknown /proc/21134/cwd (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21134 root rtd unknown /proc/21134/root (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21134 root txt unknown /proc/21134/exe (readlink: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21134 root NOFD /proc/21134/fd (opendir: Permission denied) 2024-09-21T07:08:34.661 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21163 root cwd unknown /proc/21163/cwd (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21163 root rtd unknown /proc/21163/root (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21163 root txt unknown /proc/21163/exe (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21163 root NOFD /proc/21163/fd (opendir: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21192 root cwd unknown /proc/21192/cwd (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21192 root rtd unknown /proc/21192/root (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21192 root txt unknown /proc/21192/exe (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21192 root NOFD /proc/21192/fd (opendir: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21221 root cwd unknown /proc/21221/cwd (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21221 root rtd unknown /proc/21221/root (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21221 root txt unknown /proc/21221/exe (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21221 root NOFD /proc/21221/fd (opendir: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21250 root cwd unknown /proc/21250/cwd (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21250 root rtd unknown /proc/21250/root (readlink: Permission denied) 2024-09-21T07:08:34.662 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21250 root txt unknown /proc/21250/exe (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21250 root NOFD /proc/21250/fd (opendir: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21414 root cwd unknown /proc/21414/cwd (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21414 root rtd unknown /proc/21414/root (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21414 root txt unknown /proc/21414/exe (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21414 root NOFD /proc/21414/fd (opendir: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21415 root cwd unknown /proc/21415/cwd (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21415 root rtd unknown /proc/21415/root (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21415 root txt unknown /proc/21415/exe (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21415 root NOFD /proc/21415/fd (opendir: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21416 root cwd unknown /proc/21416/cwd (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21416 root rtd unknown /proc/21416/root (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21416 root txt unknown /proc/21416/exe (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21416 root NOFD /proc/21416/fd (opendir: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21417 root cwd unknown /proc/21417/cwd (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21417 root rtd unknown /proc/21417/root (readlink: Permission denied) 2024-09-21T07:08:34.663 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21417 root txt unknown /proc/21417/exe (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21417 root NOFD /proc/21417/fd (opendir: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21418 root cwd unknown /proc/21418/cwd (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21418 root rtd unknown /proc/21418/root (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21418 root txt unknown /proc/21418/exe (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21418 root NOFD /proc/21418/fd (opendir: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21419 root cwd unknown /proc/21419/cwd (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21419 root rtd unknown /proc/21419/root (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21419 root txt unknown /proc/21419/exe (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21419 root NOFD /proc/21419/fd (opendir: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21420 root cwd unknown /proc/21420/cwd (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21420 root rtd unknown /proc/21420/root (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21420 root txt unknown /proc/21420/exe (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21420 root NOFD /proc/21420/fd (opendir: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21421 root cwd unknown /proc/21421/cwd (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21421 root rtd unknown /proc/21421/root (readlink: Permission denied) 2024-09-21T07:08:34.664 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21421 root txt unknown /proc/21421/exe (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21421 root NOFD /proc/21421/fd (opendir: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21422 root cwd unknown /proc/21422/cwd (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21422 root rtd unknown /proc/21422/root (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21422 root txt unknown /proc/21422/exe (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 21422 root NOFD /proc/21422/fd (opendir: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:xfsaild/d 21423 root cwd unknown /proc/21423/cwd (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:xfsaild/d 21423 root rtd unknown /proc/21423/root (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:xfsaild/d 21423 root txt unknown /proc/21423/exe (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:xfsaild/d 21423 root NOFD /proc/21423/fd (opendir: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22355 root cwd unknown /proc/22355/cwd (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22355 root rtd unknown /proc/22355/root (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22355 root txt unknown /proc/22355/exe (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22355 root NOFD /proc/22355/fd (opendir: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22358 ubuntu cwd unknown /proc/22358/cwd (readlink: Permission denied) 2024-09-21T07:08:34.665 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22358 ubuntu rtd unknown /proc/22358/root (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22358 ubuntu txt unknown /proc/22358/exe (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 22358 ubuntu NOFD /proc/22358/fd (opendir: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:chronyd 22418 chrony cwd unknown /proc/22418/cwd (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:chronyd 22418 chrony rtd unknown /proc/22418/root (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:chronyd 22418 chrony txt unknown /proc/22418/exe (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:chronyd 22418 chrony NOFD /proc/22418/fd (opendir: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-cras 22730 ceph cwd unknown /proc/22730/cwd (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-cras 22730 ceph rtd unknown /proc/22730/root (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-cras 22730 ceph txt unknown /proc/22730/exe (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-cras 22730 ceph NOFD /proc/22730/fd (opendir: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24503 root cwd unknown /proc/24503/cwd (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24503 root rtd unknown /proc/24503/root (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24503 root txt unknown /proc/24503/exe (readlink: Permission denied) 2024-09-21T07:08:34.666 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24503 root NOFD /proc/24503/fd (opendir: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24504 root cwd unknown /proc/24504/cwd (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24504 root rtd unknown /proc/24504/root (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24504 root txt unknown /proc/24504/exe (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 24504 root NOFD /proc/24504/fd (opendir: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25845 root cwd unknown /proc/25845/cwd (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25845 root rtd unknown /proc/25845/root (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25845 root txt unknown /proc/25845/exe (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25845 root NOFD /proc/25845/fd (opendir: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25846 root cwd unknown /proc/25846/cwd (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25846 root rtd unknown /proc/25846/root (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25846 root txt unknown /proc/25846/exe (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 25846 root NOFD /proc/25846/fd (opendir: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30211 root cwd unknown /proc/30211/cwd (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30211 root rtd unknown /proc/30211/root (readlink: Permission denied) 2024-09-21T07:08:34.667 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30211 root txt unknown /proc/30211/exe (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30211 root NOFD /proc/30211/fd (opendir: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30228 root cwd unknown /proc/30228/cwd (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30228 root rtd unknown /proc/30228/root (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30228 root txt unknown /proc/30228/exe (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30228 root NOFD /proc/30228/fd (opendir: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30229 root cwd unknown /proc/30229/cwd (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30229 root rtd unknown /proc/30229/root (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30229 root txt unknown /proc/30229/exe (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 30229 root NOFD /proc/30229/fd (opendir: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30246 root cwd unknown /proc/30246/cwd (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30246 root rtd unknown /proc/30246/root (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30246 root txt unknown /proc/30246/exe (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 30246 root NOFD /proc/30246/fd (opendir: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31209 root cwd unknown /proc/31209/cwd (readlink: Permission denied) 2024-09-21T07:08:34.668 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31209 root rtd unknown /proc/31209/root (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31209 root txt unknown /proc/31209/exe (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31209 root NOFD /proc/31209/fd (opendir: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31211 root cwd unknown /proc/31211/cwd (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31211 root rtd unknown /proc/31211/root (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31211 root txt unknown /proc/31211/exe (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31211 root NOFD /proc/31211/fd (opendir: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 ceph cwd unknown /proc/31213/cwd (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 ceph rtd unknown /proc/31213/root (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 ceph txt unknown /proc/31213/exe (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 ceph NOFD /proc/31213/fd (opendir: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31214 log ceph cwd unknown /proc/31213/task/31214/cwd (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31214 log ceph rtd unknown /proc/31213/task/31214/root (readlink: Permission denied) 2024-09-21T07:08:34.669 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31214 log ceph txt unknown /proc/31213/task/31214/exe (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31214 log ceph NOFD /proc/31213/task/31214/fd (opendir: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31215 service ceph cwd unknown /proc/31213/task/31215/cwd (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31215 service ceph rtd unknown /proc/31213/task/31215/root (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31215 service ceph txt unknown /proc/31213/task/31215/exe (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31215 service ceph NOFD /proc/31213/task/31215/fd (opendir: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31216 admin_soc ceph cwd unknown /proc/31213/task/31216/cwd (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31216 admin_soc ceph rtd unknown /proc/31213/task/31216/root (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31216 admin_soc ceph txt unknown /proc/31213/task/31216/exe (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31216 admin_soc ceph NOFD /proc/31213/task/31216/fd (opendir: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31217 signal_ha ceph cwd unknown /proc/31213/task/31217/cwd (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31217 signal_ha ceph rtd unknown /proc/31213/task/31217/root (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31217 signal_ha ceph txt unknown /proc/31213/task/31217/exe (readlink: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31217 signal_ha ceph NOFD /proc/31213/task/31217/fd (opendir: Permission denied) 2024-09-21T07:08:34.670 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31218 rocksdb:l ceph cwd unknown /proc/31213/task/31218/cwd (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31218 rocksdb:l ceph rtd unknown /proc/31213/task/31218/root (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31218 rocksdb:l ceph txt unknown /proc/31213/task/31218/exe (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31218 rocksdb:l ceph NOFD /proc/31213/task/31218/fd (opendir: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31219 rocksdb:h ceph cwd unknown /proc/31213/task/31219/cwd (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31219 rocksdb:h ceph rtd unknown /proc/31213/task/31219/root (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31219 rocksdb:h ceph txt unknown /proc/31213/task/31219/exe (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31219 rocksdb:h ceph NOFD /proc/31213/task/31219/fd (opendir: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31235 ceph-mon ceph cwd unknown /proc/31213/task/31235/cwd (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31235 ceph-mon ceph rtd unknown /proc/31213/task/31235/root (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31235 ceph-mon ceph txt unknown /proc/31213/task/31235/exe (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31235 ceph-mon ceph NOFD /proc/31213/task/31235/fd (opendir: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31236 fn_monsto ceph cwd unknown /proc/31213/task/31236/cwd (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31236 fn_monsto ceph rtd unknown /proc/31213/task/31236/root (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31236 fn_monsto ceph txt unknown /proc/31213/task/31236/exe (readlink: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31236 fn_monsto ceph NOFD /proc/31213/task/31236/fd (opendir: Permission denied) 2024-09-21T07:08:34.671 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31237 msgr-work ceph cwd unknown /proc/31213/task/31237/cwd (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31237 msgr-work ceph rtd unknown /proc/31213/task/31237/root (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31237 msgr-work ceph txt unknown /proc/31213/task/31237/exe (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31237 msgr-work ceph NOFD /proc/31213/task/31237/fd (opendir: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31238 msgr-work ceph cwd unknown /proc/31213/task/31238/cwd (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31238 msgr-work ceph rtd unknown /proc/31213/task/31238/root (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31238 msgr-work ceph txt unknown /proc/31213/task/31238/exe (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31238 msgr-work ceph NOFD /proc/31213/task/31238/fd (opendir: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31239 msgr-work ceph cwd unknown /proc/31213/task/31239/cwd (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31239 msgr-work ceph rtd unknown /proc/31213/task/31239/root (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31239 msgr-work ceph txt unknown /proc/31213/task/31239/exe (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31239 msgr-work ceph NOFD /proc/31213/task/31239/fd (opendir: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31240 OpHistory ceph cwd unknown /proc/31213/task/31240/cwd (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31240 OpHistory ceph rtd unknown /proc/31213/task/31240/root (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31240 OpHistory ceph txt unknown /proc/31213/task/31240/exe (readlink: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31240 OpHistory ceph NOFD /proc/31213/task/31240/fd (opendir: Permission denied) 2024-09-21T07:08:34.672 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31241 fin ceph cwd unknown /proc/31213/task/31241/cwd (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31241 fin ceph rtd unknown /proc/31213/task/31241/root (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31241 fin ceph txt unknown /proc/31213/task/31241/exe (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31241 fin ceph NOFD /proc/31213/task/31241/fd (opendir: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31242 safe_time ceph cwd unknown /proc/31213/task/31242/cwd (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31242 safe_time ceph rtd unknown /proc/31213/task/31242/root (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31242 safe_time ceph txt unknown /proc/31213/task/31242/exe (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31242 safe_time ceph NOFD /proc/31213/task/31242/fd (opendir: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31243 cpu_tp ceph cwd unknown /proc/31213/task/31243/cwd (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31243 cpu_tp ceph rtd unknown /proc/31213/task/31243/root (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31243 cpu_tp ceph txt unknown /proc/31213/task/31243/exe (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31243 cpu_tp ceph NOFD /proc/31213/task/31243/fd (opendir: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31244 cpu_tp ceph cwd unknown /proc/31213/task/31244/cwd (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31244 cpu_tp ceph rtd unknown /proc/31213/task/31244/root (readlink: Permission denied) 2024-09-21T07:08:34.673 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31244 cpu_tp ceph txt unknown /proc/31213/task/31244/exe (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31244 cpu_tp ceph NOFD /proc/31213/task/31244/fd (opendir: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31245 cpu_tp ceph cwd unknown /proc/31213/task/31245/cwd (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31245 cpu_tp ceph rtd unknown /proc/31213/task/31245/root (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31245 cpu_tp ceph txt unknown /proc/31213/task/31245/exe (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31245 cpu_tp ceph NOFD /proc/31213/task/31245/fd (opendir: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31246 cpu_tp ceph cwd unknown /proc/31213/task/31246/cwd (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31246 cpu_tp ceph rtd unknown /proc/31213/task/31246/root (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31246 cpu_tp ceph txt unknown /proc/31213/task/31246/exe (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31246 cpu_tp ceph NOFD /proc/31213/task/31246/fd (opendir: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31247 ms_dispat ceph cwd unknown /proc/31213/task/31247/cwd (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31247 ms_dispat ceph rtd unknown /proc/31213/task/31247/root (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31247 ms_dispat ceph txt unknown /proc/31213/task/31247/exe (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31247 ms_dispat ceph NOFD /proc/31213/task/31247/fd (opendir: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31248 ms_local ceph cwd unknown /proc/31213/task/31248/cwd (readlink: Permission denied) 2024-09-21T07:08:34.674 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31248 ms_local ceph rtd unknown /proc/31213/task/31248/root (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31248 ms_local ceph txt unknown /proc/31213/task/31248/exe (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31248 ms_local ceph NOFD /proc/31213/task/31248/fd (opendir: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31249 safe_time ceph cwd unknown /proc/31213/task/31249/cwd (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31249 safe_time ceph rtd unknown /proc/31213/task/31249/root (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31249 safe_time ceph txt unknown /proc/31213/task/31249/exe (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31249 safe_time ceph NOFD /proc/31213/task/31249/fd (opendir: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31250 ms_dispat ceph cwd unknown /proc/31213/task/31250/cwd (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31250 ms_dispat ceph rtd unknown /proc/31213/task/31250/root (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31250 ms_dispat ceph txt unknown /proc/31213/task/31250/exe (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31250 ms_dispat ceph NOFD /proc/31213/task/31250/fd (opendir: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31251 ms_local ceph cwd unknown /proc/31213/task/31251/cwd (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31251 ms_local ceph rtd unknown /proc/31213/task/31251/root (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31251 ms_local ceph txt unknown /proc/31213/task/31251/exe (readlink: Permission denied) 2024-09-21T07:08:34.675 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 31251 ms_local ceph NOFD /proc/31213/task/31251/fd (opendir: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 69708 rstore_co ceph cwd unknown /proc/31213/task/69708/cwd (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 69708 rstore_co ceph rtd unknown /proc/31213/task/69708/root (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 69708 rstore_co ceph txt unknown /proc/31213/task/69708/exe (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mon 31213 69708 rstore_co ceph NOFD /proc/31213/task/69708/fd (opendir: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31441 root cwd unknown /proc/31441/cwd (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31441 root rtd unknown /proc/31441/root (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31441 root txt unknown /proc/31441/exe (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 31441 root NOFD /proc/31441/fd (opendir: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31443 root cwd unknown /proc/31443/cwd (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31443 root rtd unknown /proc/31443/root (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31443 root txt unknown /proc/31443/exe (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 31443 root NOFD /proc/31443/fd (opendir: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 ceph cwd unknown /proc/31445/cwd (readlink: Permission denied) 2024-09-21T07:08:34.676 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 ceph rtd unknown /proc/31445/root (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 ceph txt unknown /proc/31445/exe (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 ceph NOFD /proc/31445/fd (opendir: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33509 log ceph cwd unknown /proc/31445/task/33509/cwd (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33509 log ceph rtd unknown /proc/31445/task/33509/root (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33509 log ceph txt unknown /proc/31445/task/33509/exe (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33509 log ceph NOFD /proc/31445/task/33509/fd (opendir: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33511 msgr-work ceph cwd unknown /proc/31445/task/33511/cwd (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33511 msgr-work ceph rtd unknown /proc/31445/task/33511/root (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33511 msgr-work ceph txt unknown /proc/31445/task/33511/exe (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33511 msgr-work ceph NOFD /proc/31445/task/33511/fd (opendir: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33512 msgr-work ceph cwd unknown /proc/31445/task/33512/cwd (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33512 msgr-work ceph rtd unknown /proc/31445/task/33512/root (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33512 msgr-work ceph txt unknown /proc/31445/task/33512/exe (readlink: Permission denied) 2024-09-21T07:08:34.677 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33512 msgr-work ceph NOFD /proc/31445/task/33512/fd (opendir: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33513 msgr-work ceph cwd unknown /proc/31445/task/33513/cwd (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33513 msgr-work ceph rtd unknown /proc/31445/task/33513/root (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33513 msgr-work ceph txt unknown /proc/31445/task/33513/exe (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33513 msgr-work ceph NOFD /proc/31445/task/33513/fd (opendir: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33517 service ceph cwd unknown /proc/31445/task/33517/cwd (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33517 service ceph rtd unknown /proc/31445/task/33517/root (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33517 service ceph txt unknown /proc/31445/task/33517/exe (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33517 service ceph NOFD /proc/31445/task/33517/fd (opendir: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33518 admin_soc ceph cwd unknown /proc/31445/task/33518/cwd (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33518 admin_soc ceph rtd unknown /proc/31445/task/33518/root (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33518 admin_soc ceph txt unknown /proc/31445/task/33518/exe (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33518 admin_soc ceph NOFD /proc/31445/task/33518/fd (opendir: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33519 ceph_time ceph cwd unknown /proc/31445/task/33519/cwd (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33519 ceph_time ceph rtd unknown /proc/31445/task/33519/root (readlink: Permission denied) 2024-09-21T07:08:34.678 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33519 ceph_time ceph txt unknown /proc/31445/task/33519/exe (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33519 ceph_time ceph NOFD /proc/31445/task/33519/fd (opendir: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33520 fn_anonym ceph cwd unknown /proc/31445/task/33520/cwd (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33520 fn_anonym ceph rtd unknown /proc/31445/task/33520/root (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33520 fn_anonym ceph txt unknown /proc/31445/task/33520/exe (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33520 fn_anonym ceph NOFD /proc/31445/task/33520/fd (opendir: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33521 signal_ha ceph cwd unknown /proc/31445/task/33521/cwd (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33521 signal_ha ceph rtd unknown /proc/31445/task/33521/root (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33521 signal_ha ceph txt unknown /proc/31445/task/33521/exe (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33521 signal_ha ceph NOFD /proc/31445/task/33521/fd (opendir: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33522 mgrsb-fin ceph cwd unknown /proc/31445/task/33522/cwd (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33522 mgrsb-fin ceph rtd unknown /proc/31445/task/33522/root (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33522 mgrsb-fin ceph txt unknown /proc/31445/task/33522/exe (readlink: Permission denied) 2024-09-21T07:08:34.679 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33522 mgrsb-fin ceph NOFD /proc/31445/task/33522/fd (opendir: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33523 ms_dispat ceph cwd unknown /proc/31445/task/33523/cwd (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33523 ms_dispat ceph rtd unknown /proc/31445/task/33523/root (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33523 ms_dispat ceph txt unknown /proc/31445/task/33523/exe (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33523 ms_dispat ceph NOFD /proc/31445/task/33523/fd (opendir: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33524 ms_local ceph cwd unknown /proc/31445/task/33524/cwd (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33524 ms_local ceph rtd unknown /proc/31445/task/33524/root (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33524 ms_local ceph txt unknown /proc/31445/task/33524/exe (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33524 ms_local ceph NOFD /proc/31445/task/33524/fd (opendir: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33525 io_contex ceph cwd unknown /proc/31445/task/33525/cwd (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33525 io_contex ceph rtd unknown /proc/31445/task/33525/root (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33525 io_contex ceph txt unknown /proc/31445/task/33525/exe (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33525 io_contex ceph NOFD /proc/31445/task/33525/fd (opendir: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33526 io_contex ceph cwd unknown /proc/31445/task/33526/cwd (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33526 io_contex ceph rtd unknown /proc/31445/task/33526/root (readlink: Permission denied) 2024-09-21T07:08:34.680 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33526 io_contex ceph txt unknown /proc/31445/task/33526/exe (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33526 io_contex ceph NOFD /proc/31445/task/33526/fd (opendir: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33527 safe_time ceph cwd unknown /proc/31445/task/33527/cwd (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33527 safe_time ceph rtd unknown /proc/31445/task/33527/root (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33527 safe_time ceph txt unknown /proc/31445/task/33527/exe (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33527 safe_time ceph NOFD /proc/31445/task/33527/fd (opendir: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33528 safe_time ceph cwd unknown /proc/31445/task/33528/cwd (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33528 safe_time ceph rtd unknown /proc/31445/task/33528/root (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33528 safe_time ceph txt unknown /proc/31445/task/33528/exe (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33528 safe_time ceph NOFD /proc/31445/task/33528/fd (opendir: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33529 safe_time ceph cwd unknown /proc/31445/task/33529/cwd (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33529 safe_time ceph rtd unknown /proc/31445/task/33529/root (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33529 safe_time ceph txt unknown /proc/31445/task/33529/exe (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33529 safe_time ceph NOFD /proc/31445/task/33529/fd (opendir: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33530 fn_anonym ceph cwd unknown /proc/31445/task/33530/cwd (readlink: Permission denied) 2024-09-21T07:08:34.681 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33530 fn_anonym ceph rtd unknown /proc/31445/task/33530/root (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33530 fn_anonym ceph txt unknown /proc/31445/task/33530/exe (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33530 fn_anonym ceph NOFD /proc/31445/task/33530/fd (opendir: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33531 flusher ceph cwd unknown /proc/31445/task/33531/cwd (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33531 flusher ceph rtd unknown /proc/31445/task/33531/root (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33531 flusher ceph txt unknown /proc/31445/task/33531/exe (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33531 flusher ceph NOFD /proc/31445/task/33531/fd (opendir: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33532 safe_time ceph cwd unknown /proc/31445/task/33532/cwd (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33532 safe_time ceph rtd unknown /proc/31445/task/33532/root (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33532 safe_time ceph txt unknown /proc/31445/task/33532/exe (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33532 safe_time ceph NOFD /proc/31445/task/33532/fd (opendir: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33648 OpHistory ceph cwd unknown /proc/31445/task/33648/cwd (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33648 OpHistory ceph rtd unknown /proc/31445/task/33648/root (readlink: Permission denied) 2024-09-21T07:08:34.682 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33648 OpHistory ceph txt unknown /proc/31445/task/33648/exe (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33648 OpHistory ceph NOFD /proc/31445/task/33648/fd (opendir: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33649 mgr-fin ceph cwd unknown /proc/31445/task/33649/cwd (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33649 mgr-fin ceph rtd unknown /proc/31445/task/33649/root (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33649 mgr-fin ceph txt unknown /proc/31445/task/33649/exe (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33649 mgr-fin ceph NOFD /proc/31445/task/33649/fd (opendir: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33650 ms_dispat ceph cwd unknown /proc/31445/task/33650/cwd (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33650 ms_dispat ceph rtd unknown /proc/31445/task/33650/root (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33650 ms_dispat ceph txt unknown /proc/31445/task/33650/exe (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33650 ms_dispat ceph NOFD /proc/31445/task/33650/fd (opendir: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33651 ms_local ceph cwd unknown /proc/31445/task/33651/cwd (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33651 ms_local ceph rtd unknown /proc/31445/task/33651/root (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33651 ms_local ceph txt unknown /proc/31445/task/33651/exe (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33651 ms_local ceph NOFD /proc/31445/task/33651/fd (opendir: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33652 safe_time ceph cwd unknown /proc/31445/task/33652/cwd (readlink: Permission denied) 2024-09-21T07:08:34.683 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33652 safe_time ceph rtd unknown /proc/31445/task/33652/root (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33652 safe_time ceph txt unknown /proc/31445/task/33652/exe (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33652 safe_time ceph NOFD /proc/31445/task/33652/fd (opendir: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33653 cmdfin ceph cwd unknown /proc/31445/task/33653/cwd (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33653 cmdfin ceph rtd unknown /proc/31445/task/33653/root (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33653 cmdfin ceph txt unknown /proc/31445/task/33653/exe (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33653 cmdfin ceph NOFD /proc/31445/task/33653/fd (opendir: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33657 io_contex ceph cwd unknown /proc/31445/task/33657/cwd (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33657 io_contex ceph rtd unknown /proc/31445/task/33657/root (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33657 io_contex ceph txt unknown /proc/31445/task/33657/exe (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33657 io_contex ceph NOFD /proc/31445/task/33657/fd (opendir: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33658 io_contex ceph cwd unknown /proc/31445/task/33658/cwd (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33658 io_contex ceph rtd unknown /proc/31445/task/33658/root (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33658 io_contex ceph txt unknown /proc/31445/task/33658/exe (readlink: Permission denied) 2024-09-21T07:08:34.684 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33658 io_contex ceph NOFD /proc/31445/task/33658/fd (opendir: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33659 ceph_time ceph cwd unknown /proc/31445/task/33659/cwd (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33659 ceph_time ceph rtd unknown /proc/31445/task/33659/root (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33659 ceph_time ceph txt unknown /proc/31445/task/33659/exe (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33659 ceph_time ceph NOFD /proc/31445/task/33659/fd (opendir: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33660 ms_dispat ceph cwd unknown /proc/31445/task/33660/cwd (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33660 ms_dispat ceph rtd unknown /proc/31445/task/33660/root (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33660 ms_dispat ceph txt unknown /proc/31445/task/33660/exe (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33660 ms_dispat ceph NOFD /proc/31445/task/33660/fd (opendir: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33661 ms_local ceph cwd unknown /proc/31445/task/33661/cwd (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33661 ms_local ceph rtd unknown /proc/31445/task/33661/root (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33661 ms_local ceph txt unknown /proc/31445/task/33661/exe (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33661 ms_local ceph NOFD /proc/31445/task/33661/fd (opendir: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33662 safe_time ceph cwd unknown /proc/31445/task/33662/cwd (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33662 safe_time ceph rtd unknown /proc/31445/task/33662/root (readlink: Permission denied) 2024-09-21T07:08:34.685 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33662 safe_time ceph txt unknown /proc/31445/task/33662/exe (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33662 safe_time ceph NOFD /proc/31445/task/33662/fd (opendir: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33663 safe_time ceph cwd unknown /proc/31445/task/33663/cwd (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33663 safe_time ceph rtd unknown /proc/31445/task/33663/root (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33663 safe_time ceph txt unknown /proc/31445/task/33663/exe (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33663 safe_time ceph NOFD /proc/31445/task/33663/fd (opendir: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33664 balancer ceph cwd unknown /proc/31445/task/33664/cwd (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33664 balancer ceph rtd unknown /proc/31445/task/33664/root (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33664 balancer ceph txt unknown /proc/31445/task/33664/exe (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33664 balancer ceph NOFD /proc/31445/task/33664/fd (opendir: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33665 m-fin-bal ceph cwd unknown /proc/31445/task/33665/cwd (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33665 m-fin-bal ceph rtd unknown /proc/31445/task/33665/root (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33665 m-fin-bal ceph txt unknown /proc/31445/task/33665/exe (readlink: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33665 m-fin-bal ceph NOFD /proc/31445/task/33665/fd (opendir: Permission denied) 2024-09-21T07:08:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33666 mgr-fin ceph cwd unknown /proc/31445/task/33666/cwd (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33666 mgr-fin ceph rtd unknown /proc/31445/task/33666/root (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33666 mgr-fin ceph txt unknown /proc/31445/task/33666/exe (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33666 mgr-fin ceph NOFD /proc/31445/task/33666/fd (opendir: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33667 mgr-fin ceph cwd unknown /proc/31445/task/33667/cwd (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33667 mgr-fin ceph rtd unknown /proc/31445/task/33667/root (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33667 mgr-fin ceph txt unknown /proc/31445/task/33667/exe (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33667 mgr-fin ceph NOFD /proc/31445/task/33667/fd (opendir: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33668 mgr-fin ceph cwd unknown /proc/31445/task/33668/cwd (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33668 mgr-fin ceph rtd unknown /proc/31445/task/33668/root (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33668 mgr-fin ceph txt unknown /proc/31445/task/33668/exe (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33668 mgr-fin ceph NOFD /proc/31445/task/33668/fd (opendir: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33669 mgr-fin ceph cwd unknown /proc/31445/task/33669/cwd (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33669 mgr-fin ceph rtd unknown /proc/31445/task/33669/root (readlink: Permission denied) 2024-09-21T07:08:34.687 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33669 mgr-fin ceph txt unknown /proc/31445/task/33669/exe (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33669 mgr-fin ceph NOFD /proc/31445/task/33669/fd (opendir: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33670 mgr-fin ceph cwd unknown /proc/31445/task/33670/cwd (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33670 mgr-fin ceph rtd unknown /proc/31445/task/33670/root (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33670 mgr-fin ceph txt unknown /proc/31445/task/33670/exe (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33670 mgr-fin ceph NOFD /proc/31445/task/33670/fd (opendir: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33671 mgr-fin ceph cwd unknown /proc/31445/task/33671/cwd (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33671 mgr-fin ceph rtd unknown /proc/31445/task/33671/root (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33671 mgr-fin ceph txt unknown /proc/31445/task/33671/exe (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33671 mgr-fin ceph NOFD /proc/31445/task/33671/fd (opendir: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33672 mgr-fin ceph cwd unknown /proc/31445/task/33672/cwd (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33672 mgr-fin ceph rtd unknown /proc/31445/task/33672/root (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33672 mgr-fin ceph txt unknown /proc/31445/task/33672/exe (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33672 mgr-fin ceph NOFD /proc/31445/task/33672/fd (opendir: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33673 mgr-fin ceph cwd unknown /proc/31445/task/33673/cwd (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33673 mgr-fin ceph rtd unknown /proc/31445/task/33673/root (readlink: Permission denied) 2024-09-21T07:08:34.688 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33673 mgr-fin ceph txt unknown /proc/31445/task/33673/exe (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33673 mgr-fin ceph NOFD /proc/31445/task/33673/fd (opendir: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33674 mgr-fin ceph cwd unknown /proc/31445/task/33674/cwd (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33674 mgr-fin ceph rtd unknown /proc/31445/task/33674/root (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33674 mgr-fin ceph txt unknown /proc/31445/task/33674/exe (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33674 mgr-fin ceph NOFD /proc/31445/task/33674/fd (opendir: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33675 mgr-fin ceph cwd unknown /proc/31445/task/33675/cwd (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33675 mgr-fin ceph rtd unknown /proc/31445/task/33675/root (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33675 mgr-fin ceph txt unknown /proc/31445/task/33675/exe (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33675 mgr-fin ceph NOFD /proc/31445/task/33675/fd (opendir: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33676 mgr-fin ceph cwd unknown /proc/31445/task/33676/cwd (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33676 mgr-fin ceph rtd unknown /proc/31445/task/33676/root (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33676 mgr-fin ceph txt unknown /proc/31445/task/33676/exe (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33676 mgr-fin ceph NOFD /proc/31445/task/33676/fd (opendir: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33677 mgr-fin ceph cwd unknown /proc/31445/task/33677/cwd (readlink: Permission denied) 2024-09-21T07:08:34.689 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33677 mgr-fin ceph rtd unknown /proc/31445/task/33677/root (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33677 mgr-fin ceph txt unknown /proc/31445/task/33677/exe (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33677 mgr-fin ceph NOFD /proc/31445/task/33677/fd (opendir: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33678 mgr-fin ceph cwd unknown /proc/31445/task/33678/cwd (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33678 mgr-fin ceph rtd unknown /proc/31445/task/33678/root (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33678 mgr-fin ceph txt unknown /proc/31445/task/33678/exe (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33678 mgr-fin ceph NOFD /proc/31445/task/33678/fd (opendir: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33679 mgr-fin ceph cwd unknown /proc/31445/task/33679/cwd (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33679 mgr-fin ceph rtd unknown /proc/31445/task/33679/root (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33679 mgr-fin ceph txt unknown /proc/31445/task/33679/exe (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33679 mgr-fin ceph NOFD /proc/31445/task/33679/fd (opendir: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33680 mgr-fin ceph cwd unknown /proc/31445/task/33680/cwd (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33680 mgr-fin ceph rtd unknown /proc/31445/task/33680/root (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33680 mgr-fin ceph txt unknown /proc/31445/task/33680/exe (readlink: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33680 mgr-fin ceph NOFD /proc/31445/task/33680/fd (opendir: Permission denied) 2024-09-21T07:08:34.690 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33681 cephadm ceph cwd unknown /proc/31445/task/33681/cwd (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33681 cephadm ceph rtd unknown /proc/31445/task/33681/root (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33681 cephadm ceph txt unknown /proc/31445/task/33681/exe (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33681 cephadm ceph NOFD /proc/31445/task/33681/fd (opendir: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33682 m-fin-cep ceph cwd unknown /proc/31445/task/33682/cwd (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33682 m-fin-cep ceph rtd unknown /proc/31445/task/33682/root (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33682 m-fin-cep ceph txt unknown /proc/31445/task/33682/exe (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33682 m-fin-cep ceph NOFD /proc/31445/task/33682/fd (opendir: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33683 mgr-fin ceph cwd unknown /proc/31445/task/33683/cwd (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33683 mgr-fin ceph rtd unknown /proc/31445/task/33683/root (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33683 mgr-fin ceph txt unknown /proc/31445/task/33683/exe (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33683 mgr-fin ceph NOFD /proc/31445/task/33683/fd (opendir: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33684 mgr-fin ceph cwd unknown /proc/31445/task/33684/cwd (readlink: Permission denied) 2024-09-21T07:08:34.691 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33684 mgr-fin ceph rtd unknown /proc/31445/task/33684/root (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33684 mgr-fin ceph txt unknown /proc/31445/task/33684/exe (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33684 mgr-fin ceph NOFD /proc/31445/task/33684/fd (opendir: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33685 mgr-fin ceph cwd unknown /proc/31445/task/33685/cwd (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33685 mgr-fin ceph rtd unknown /proc/31445/task/33685/root (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33685 mgr-fin ceph txt unknown /proc/31445/task/33685/exe (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33685 mgr-fin ceph NOFD /proc/31445/task/33685/fd (opendir: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33686 cephadm ceph cwd unknown /proc/31445/task/33686/cwd (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33686 cephadm ceph rtd unknown /proc/31445/task/33686/root (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33686 cephadm ceph txt unknown /proc/31445/task/33686/exe (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33686 cephadm ceph NOFD /proc/31445/task/33686/fd (opendir: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33687 mgr-fin ceph cwd unknown /proc/31445/task/33687/cwd (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33687 mgr-fin ceph rtd unknown /proc/31445/task/33687/root (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33687 mgr-fin ceph txt unknown /proc/31445/task/33687/exe (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33687 mgr-fin ceph NOFD /proc/31445/task/33687/fd (opendir: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33688 crash ceph cwd unknown /proc/31445/task/33688/cwd (readlink: Permission denied) 2024-09-21T07:08:34.692 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33688 crash ceph rtd unknown /proc/31445/task/33688/root (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33688 crash ceph txt unknown /proc/31445/task/33688/exe (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33688 crash ceph NOFD /proc/31445/task/33688/fd (opendir: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33689 mgr-fin ceph cwd unknown /proc/31445/task/33689/cwd (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33689 mgr-fin ceph rtd unknown /proc/31445/task/33689/root (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33689 mgr-fin ceph txt unknown /proc/31445/task/33689/exe (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33689 mgr-fin ceph NOFD /proc/31445/task/33689/fd (opendir: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33690 m-fin-cra ceph cwd unknown /proc/31445/task/33690/cwd (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33690 m-fin-cra ceph rtd unknown /proc/31445/task/33690/root (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33690 m-fin-cra ceph txt unknown /proc/31445/task/33690/exe (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33690 m-fin-cra ceph NOFD /proc/31445/task/33690/fd (opendir: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33691 mgr-fin ceph cwd unknown /proc/31445/task/33691/cwd (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33691 mgr-fin ceph rtd unknown /proc/31445/task/33691/root (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33691 mgr-fin ceph txt unknown /proc/31445/task/33691/exe (readlink: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33691 mgr-fin ceph NOFD /proc/31445/task/33691/fd (opendir: Permission denied) 2024-09-21T07:08:34.693 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33692 mgr-fin ceph cwd unknown /proc/31445/task/33692/cwd (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33692 mgr-fin ceph rtd unknown /proc/31445/task/33692/root (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33692 mgr-fin ceph txt unknown /proc/31445/task/33692/exe (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33692 mgr-fin ceph NOFD /proc/31445/task/33692/fd (opendir: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33693 dashboard ceph cwd unknown /proc/31445/task/33693/cwd (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33693 dashboard ceph rtd unknown /proc/31445/task/33693/root (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33693 dashboard ceph txt unknown /proc/31445/task/33693/exe (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33693 dashboard ceph NOFD /proc/31445/task/33693/fd (opendir: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33694 m-fin-das ceph cwd unknown /proc/31445/task/33694/cwd (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33694 m-fin-das ceph rtd unknown /proc/31445/task/33694/root (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33694 m-fin-das ceph txt unknown /proc/31445/task/33694/exe (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33694 m-fin-das ceph NOFD /proc/31445/task/33694/fd (opendir: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33695 mgr-fin ceph cwd unknown /proc/31445/task/33695/cwd (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33695 mgr-fin ceph rtd unknown /proc/31445/task/33695/root (readlink: Permission denied) 2024-09-21T07:08:34.694 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33695 mgr-fin ceph txt unknown /proc/31445/task/33695/exe (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33695 mgr-fin ceph NOFD /proc/31445/task/33695/fd (opendir: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33696 mgr-fin ceph cwd unknown /proc/31445/task/33696/cwd (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33696 mgr-fin ceph rtd unknown /proc/31445/task/33696/root (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33696 mgr-fin ceph txt unknown /proc/31445/task/33696/exe (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33696 mgr-fin ceph NOFD /proc/31445/task/33696/fd (opendir: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33697 devicehea ceph cwd unknown /proc/31445/task/33697/cwd (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33697 devicehea ceph rtd unknown /proc/31445/task/33697/root (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33697 devicehea ceph txt unknown /proc/31445/task/33697/exe (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33697 devicehea ceph NOFD /proc/31445/task/33697/fd (opendir: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33698 m-fin-dev ceph cwd unknown /proc/31445/task/33698/cwd (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33698 m-fin-dev ceph rtd unknown /proc/31445/task/33698/root (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33698 m-fin-dev ceph txt unknown /proc/31445/task/33698/exe (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33698 m-fin-dev ceph NOFD /proc/31445/task/33698/fd (opendir: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33699 mgr-fin ceph cwd unknown /proc/31445/task/33699/cwd (readlink: Permission denied) 2024-09-21T07:08:34.695 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33699 mgr-fin ceph rtd unknown /proc/31445/task/33699/root (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33699 mgr-fin ceph txt unknown /proc/31445/task/33699/exe (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33699 mgr-fin ceph NOFD /proc/31445/task/33699/fd (opendir: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33700 mgr-fin ceph cwd unknown /proc/31445/task/33700/cwd (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33700 mgr-fin ceph rtd unknown /proc/31445/task/33700/root (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33700 mgr-fin ceph txt unknown /proc/31445/task/33700/exe (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33700 mgr-fin ceph NOFD /proc/31445/task/33700/fd (opendir: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33702 m-fin-ios ceph cwd unknown /proc/31445/task/33702/cwd (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33702 m-fin-ios ceph rtd unknown /proc/31445/task/33702/root (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33702 m-fin-ios ceph txt unknown /proc/31445/task/33702/exe (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33702 m-fin-ios ceph NOFD /proc/31445/task/33702/fd (opendir: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33703 mgr-fin ceph cwd unknown /proc/31445/task/33703/cwd (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33703 mgr-fin ceph rtd unknown /proc/31445/task/33703/root (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33703 mgr-fin ceph txt unknown /proc/31445/task/33703/exe (readlink: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33703 mgr-fin ceph NOFD /proc/31445/task/33703/fd (opendir: Permission denied) 2024-09-21T07:08:34.696 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33704 mgr-fin ceph cwd unknown /proc/31445/task/33704/cwd (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33704 mgr-fin ceph rtd unknown /proc/31445/task/33704/root (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33704 mgr-fin ceph txt unknown /proc/31445/task/33704/exe (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33704 mgr-fin ceph NOFD /proc/31445/task/33704/fd (opendir: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33706 m-fin-nfs ceph cwd unknown /proc/31445/task/33706/cwd (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33706 m-fin-nfs ceph rtd unknown /proc/31445/task/33706/root (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33706 m-fin-nfs ceph txt unknown /proc/31445/task/33706/exe (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33706 m-fin-nfs ceph NOFD /proc/31445/task/33706/fd (opendir: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33707 cephadm ceph cwd unknown /proc/31445/task/33707/cwd (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33707 cephadm ceph rtd unknown /proc/31445/task/33707/root (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33707 cephadm ceph txt unknown /proc/31445/task/33707/exe (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33707 cephadm ceph NOFD /proc/31445/task/33707/fd (opendir: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33709 m-fin-orc ceph cwd unknown /proc/31445/task/33709/cwd (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33709 m-fin-orc ceph rtd unknown /proc/31445/task/33709/root (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33709 m-fin-orc ceph txt unknown /proc/31445/task/33709/exe (readlink: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33709 m-fin-orc ceph NOFD /proc/31445/task/33709/fd (opendir: Permission denied) 2024-09-21T07:08:34.697 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33710 pg_autosc ceph cwd unknown /proc/31445/task/33710/cwd (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33710 pg_autosc ceph rtd unknown /proc/31445/task/33710/root (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33710 pg_autosc ceph txt unknown /proc/31445/task/33710/exe (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33710 pg_autosc ceph NOFD /proc/31445/task/33710/fd (opendir: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33711 m-fin-pg_ ceph cwd unknown /proc/31445/task/33711/cwd (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33711 m-fin-pg_ ceph rtd unknown /proc/31445/task/33711/root (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33711 m-fin-pg_ ceph txt unknown /proc/31445/task/33711/exe (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33711 m-fin-pg_ ceph NOFD /proc/31445/task/33711/fd (opendir: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33712 progress ceph cwd unknown /proc/31445/task/33712/cwd (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33712 progress ceph rtd unknown /proc/31445/task/33712/root (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33712 progress ceph txt unknown /proc/31445/task/33712/exe (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33712 progress ceph NOFD /proc/31445/task/33712/fd (opendir: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33713 m-fin-pro ceph cwd unknown /proc/31445/task/33713/cwd (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33713 m-fin-pro ceph rtd unknown /proc/31445/task/33713/root (readlink: Permission denied) 2024-09-21T07:08:34.698 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33713 m-fin-pro ceph txt unknown /proc/31445/task/33713/exe (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33713 m-fin-pro ceph NOFD /proc/31445/task/33713/fd (opendir: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33717 io_contex ceph cwd unknown /proc/31445/task/33717/cwd (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33717 io_contex ceph rtd unknown /proc/31445/task/33717/root (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33717 io_contex ceph txt unknown /proc/31445/task/33717/exe (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33717 io_contex ceph NOFD /proc/31445/task/33717/fd (opendir: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33718 io_contex ceph cwd unknown /proc/31445/task/33718/cwd (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33718 io_contex ceph rtd unknown /proc/31445/task/33718/root (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33718 io_contex ceph txt unknown /proc/31445/task/33718/exe (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33718 io_contex ceph NOFD /proc/31445/task/33718/fd (opendir: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33719 ceph_time ceph cwd unknown /proc/31445/task/33719/cwd (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33719 ceph_time ceph rtd unknown /proc/31445/task/33719/root (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33719 ceph_time ceph txt unknown /proc/31445/task/33719/exe (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33719 ceph_time ceph NOFD /proc/31445/task/33719/fd (opendir: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33720 ms_dispat ceph cwd unknown /proc/31445/task/33720/cwd (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33720 ms_dispat ceph rtd unknown /proc/31445/task/33720/root (readlink: Permission denied) 2024-09-21T07:08:34.699 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33720 ms_dispat ceph txt unknown /proc/31445/task/33720/exe (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33720 ms_dispat ceph NOFD /proc/31445/task/33720/fd (opendir: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33721 ms_local ceph cwd unknown /proc/31445/task/33721/cwd (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33721 ms_local ceph rtd unknown /proc/31445/task/33721/root (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33721 ms_local ceph txt unknown /proc/31445/task/33721/exe (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33721 ms_local ceph NOFD /proc/31445/task/33721/fd (opendir: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33722 safe_time ceph cwd unknown /proc/31445/task/33722/cwd (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33722 safe_time ceph rtd unknown /proc/31445/task/33722/root (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33722 safe_time ceph txt unknown /proc/31445/task/33722/exe (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33722 safe_time ceph NOFD /proc/31445/task/33722/fd (opendir: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33723 safe_time ceph cwd unknown /proc/31445/task/33723/cwd (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33723 safe_time ceph rtd unknown /proc/31445/task/33723/root (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33723 safe_time ceph txt unknown /proc/31445/task/33723/exe (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33723 safe_time ceph NOFD /proc/31445/task/33723/fd (opendir: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33724 mgr-fin ceph cwd unknown /proc/31445/task/33724/cwd (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33724 mgr-fin ceph rtd unknown /proc/31445/task/33724/root (readlink: Permission denied) 2024-09-21T07:08:34.700 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33724 mgr-fin ceph txt unknown /proc/31445/task/33724/exe (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33724 mgr-fin ceph NOFD /proc/31445/task/33724/fd (opendir: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33726 m-fin-rbd ceph cwd unknown /proc/31445/task/33726/cwd (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33726 m-fin-rbd ceph rtd unknown /proc/31445/task/33726/root (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33726 m-fin-rbd ceph txt unknown /proc/31445/task/33726/exe (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33726 m-fin-rbd ceph NOFD /proc/31445/task/33726/fd (opendir: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33727 restful ceph cwd unknown /proc/31445/task/33727/cwd (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33727 restful ceph rtd unknown /proc/31445/task/33727/root (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33727 restful ceph txt unknown /proc/31445/task/33727/exe (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33727 restful ceph NOFD /proc/31445/task/33727/fd (opendir: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33728 m-fin-res ceph cwd unknown /proc/31445/task/33728/cwd (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33728 m-fin-res ceph rtd unknown /proc/31445/task/33728/root (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33728 m-fin-res ceph txt unknown /proc/31445/task/33728/exe (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33728 m-fin-res ceph NOFD /proc/31445/task/33728/fd (opendir: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33730 m-fin-sta ceph cwd unknown /proc/31445/task/33730/cwd (readlink: Permission denied) 2024-09-21T07:08:34.701 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33730 m-fin-sta ceph rtd unknown /proc/31445/task/33730/root (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33730 m-fin-sta ceph txt unknown /proc/31445/task/33730/exe (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33730 m-fin-sta ceph NOFD /proc/31445/task/33730/fd (opendir: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33731 telemetry ceph cwd unknown /proc/31445/task/33731/cwd (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33731 telemetry ceph rtd unknown /proc/31445/task/33731/root (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33731 telemetry ceph txt unknown /proc/31445/task/33731/exe (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33731 telemetry ceph NOFD /proc/31445/task/33731/fd (opendir: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33732 m-fin-tel ceph cwd unknown /proc/31445/task/33732/cwd (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33732 m-fin-tel ceph rtd unknown /proc/31445/task/33732/root (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33732 m-fin-tel ceph txt unknown /proc/31445/task/33732/exe (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33732 m-fin-tel ceph NOFD /proc/31445/task/33732/fd (opendir: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33733 mgr-fin ceph cwd unknown /proc/31445/task/33733/cwd (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33733 mgr-fin ceph rtd unknown /proc/31445/task/33733/root (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33733 mgr-fin ceph txt unknown /proc/31445/task/33733/exe (readlink: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33733 mgr-fin ceph NOFD /proc/31445/task/33733/fd (opendir: Permission denied) 2024-09-21T07:08:34.702 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33734 mgr-fin ceph cwd unknown /proc/31445/task/33734/cwd (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33734 mgr-fin ceph rtd unknown /proc/31445/task/33734/root (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33734 mgr-fin ceph txt unknown /proc/31445/task/33734/exe (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33734 mgr-fin ceph NOFD /proc/31445/task/33734/fd (opendir: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33735 mgr-fin ceph cwd unknown /proc/31445/task/33735/cwd (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33735 mgr-fin ceph rtd unknown /proc/31445/task/33735/root (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33735 mgr-fin ceph txt unknown /proc/31445/task/33735/exe (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33735 mgr-fin ceph NOFD /proc/31445/task/33735/fd (opendir: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33736 mgr-fin ceph cwd unknown /proc/31445/task/33736/cwd (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33736 mgr-fin ceph rtd unknown /proc/31445/task/33736/root (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33736 mgr-fin ceph txt unknown /proc/31445/task/33736/exe (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33736 mgr-fin ceph NOFD /proc/31445/task/33736/fd (opendir: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33740 mgr-fin ceph cwd unknown /proc/31445/task/33740/cwd (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33740 mgr-fin ceph rtd unknown /proc/31445/task/33740/root (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33740 mgr-fin ceph txt unknown /proc/31445/task/33740/exe (readlink: Permission denied) 2024-09-21T07:08:34.703 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33740 mgr-fin ceph NOFD /proc/31445/task/33740/fd (opendir: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33741 io_contex ceph cwd unknown /proc/31445/task/33741/cwd (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33741 io_contex ceph rtd unknown /proc/31445/task/33741/root (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33741 io_contex ceph txt unknown /proc/31445/task/33741/exe (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33741 io_contex ceph NOFD /proc/31445/task/33741/fd (opendir: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33742 io_contex ceph cwd unknown /proc/31445/task/33742/cwd (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33742 io_contex ceph rtd unknown /proc/31445/task/33742/root (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33742 io_contex ceph txt unknown /proc/31445/task/33742/exe (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33742 io_contex ceph NOFD /proc/31445/task/33742/fd (opendir: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33743 ceph_time ceph cwd unknown /proc/31445/task/33743/cwd (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33743 ceph_time ceph rtd unknown /proc/31445/task/33743/root (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33743 ceph_time ceph txt unknown /proc/31445/task/33743/exe (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33743 ceph_time ceph NOFD /proc/31445/task/33743/fd (opendir: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33744 ms_dispat ceph cwd unknown /proc/31445/task/33744/cwd (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33744 ms_dispat ceph rtd unknown /proc/31445/task/33744/root (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33744 ms_dispat ceph txt unknown /proc/31445/task/33744/exe (readlink: Permission denied) 2024-09-21T07:08:34.704 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33744 ms_dispat ceph NOFD /proc/31445/task/33744/fd (opendir: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33745 ms_local ceph cwd unknown /proc/31445/task/33745/cwd (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33745 ms_local ceph rtd unknown /proc/31445/task/33745/root (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33745 ms_local ceph txt unknown /proc/31445/task/33745/exe (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33745 ms_local ceph NOFD /proc/31445/task/33745/fd (opendir: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33746 safe_time ceph cwd unknown /proc/31445/task/33746/cwd (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33746 safe_time ceph rtd unknown /proc/31445/task/33746/root (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33746 safe_time ceph txt unknown /proc/31445/task/33746/exe (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33746 safe_time ceph NOFD /proc/31445/task/33746/fd (opendir: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33747 safe_time ceph cwd unknown /proc/31445/task/33747/cwd (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33747 safe_time ceph rtd unknown /proc/31445/task/33747/root (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33747 safe_time ceph txt unknown /proc/31445/task/33747/exe (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33747 safe_time ceph NOFD /proc/31445/task/33747/fd (opendir: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33748 mgr-fin ceph cwd unknown /proc/31445/task/33748/cwd (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33748 mgr-fin ceph rtd unknown /proc/31445/task/33748/root (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33748 mgr-fin ceph txt unknown /proc/31445/task/33748/exe (readlink: Permission denied) 2024-09-21T07:08:34.705 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33748 mgr-fin ceph NOFD /proc/31445/task/33748/fd (opendir: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33749 mgr-fin ceph cwd unknown /proc/31445/task/33749/cwd (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33749 mgr-fin ceph rtd unknown /proc/31445/task/33749/root (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33749 mgr-fin ceph txt unknown /proc/31445/task/33749/exe (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33749 mgr-fin ceph NOFD /proc/31445/task/33749/fd (opendir: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33750 mgr-fin ceph cwd unknown /proc/31445/task/33750/cwd (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33750 mgr-fin ceph rtd unknown /proc/31445/task/33750/root (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33750 mgr-fin ceph txt unknown /proc/31445/task/33750/exe (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33750 mgr-fin ceph NOFD /proc/31445/task/33750/fd (opendir: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33751 mgr-fin ceph cwd unknown /proc/31445/task/33751/cwd (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33751 mgr-fin ceph rtd unknown /proc/31445/task/33751/root (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33751 mgr-fin ceph txt unknown /proc/31445/task/33751/exe (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33751 mgr-fin ceph NOFD /proc/31445/task/33751/fd (opendir: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33752 mgr-fin ceph cwd unknown /proc/31445/task/33752/cwd (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33752 mgr-fin ceph rtd unknown /proc/31445/task/33752/root (readlink: Permission denied) 2024-09-21T07:08:34.706 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33752 mgr-fin ceph txt unknown /proc/31445/task/33752/exe (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33752 mgr-fin ceph NOFD /proc/31445/task/33752/fd (opendir: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33753 mgr-fin ceph cwd unknown /proc/31445/task/33753/cwd (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33753 mgr-fin ceph rtd unknown /proc/31445/task/33753/root (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33753 mgr-fin ceph txt unknown /proc/31445/task/33753/exe (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33753 mgr-fin ceph NOFD /proc/31445/task/33753/fd (opendir: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33754 mgr-fin ceph cwd unknown /proc/31445/task/33754/cwd (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33754 mgr-fin ceph rtd unknown /proc/31445/task/33754/root (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33754 mgr-fin ceph txt unknown /proc/31445/task/33754/exe (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33754 mgr-fin ceph NOFD /proc/31445/task/33754/fd (opendir: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33755 mgr-fin ceph cwd unknown /proc/31445/task/33755/cwd (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33755 mgr-fin ceph rtd unknown /proc/31445/task/33755/root (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33755 mgr-fin ceph txt unknown /proc/31445/task/33755/exe (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33755 mgr-fin ceph NOFD /proc/31445/task/33755/fd (opendir: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33756 mgr-fin ceph cwd unknown /proc/31445/task/33756/cwd (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33756 mgr-fin ceph rtd unknown /proc/31445/task/33756/root (readlink: Permission denied) 2024-09-21T07:08:34.707 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33756 mgr-fin ceph txt unknown /proc/31445/task/33756/exe (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33756 mgr-fin ceph NOFD /proc/31445/task/33756/fd (opendir: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33757 mgr-fin ceph cwd unknown /proc/31445/task/33757/cwd (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33757 mgr-fin ceph rtd unknown /proc/31445/task/33757/root (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33757 mgr-fin ceph txt unknown /proc/31445/task/33757/exe (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33757 mgr-fin ceph NOFD /proc/31445/task/33757/fd (opendir: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33758 mgr-fin ceph cwd unknown /proc/31445/task/33758/cwd (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33758 mgr-fin ceph rtd unknown /proc/31445/task/33758/root (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33758 mgr-fin ceph txt unknown /proc/31445/task/33758/exe (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33758 mgr-fin ceph NOFD /proc/31445/task/33758/fd (opendir: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33759 mgr-fin ceph cwd unknown /proc/31445/task/33759/cwd (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33759 mgr-fin ceph rtd unknown /proc/31445/task/33759/root (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33759 mgr-fin ceph txt unknown /proc/31445/task/33759/exe (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33759 mgr-fin ceph NOFD /proc/31445/task/33759/fd (opendir: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33761 m-fin-vol ceph cwd unknown /proc/31445/task/33761/cwd (readlink: Permission denied) 2024-09-21T07:08:34.708 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33761 m-fin-vol ceph rtd unknown /proc/31445/task/33761/root (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33761 m-fin-vol ceph txt unknown /proc/31445/task/33761/exe (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 33761 m-fin-vol ceph NOFD /proc/31445/task/33761/fd (opendir: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34026 mgr-fin ceph cwd unknown /proc/31445/task/34026/cwd (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34026 mgr-fin ceph rtd unknown /proc/31445/task/34026/root (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34026 mgr-fin ceph txt unknown /proc/31445/task/34026/exe (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34026 mgr-fin ceph NOFD /proc/31445/task/34026/fd (opendir: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34027 mgr-fin ceph cwd unknown /proc/31445/task/34027/cwd (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34027 mgr-fin ceph rtd unknown /proc/31445/task/34027/root (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34027 mgr-fin ceph txt unknown /proc/31445/task/34027/exe (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34027 mgr-fin ceph NOFD /proc/31445/task/34027/fd (opendir: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34028 mgr-fin ceph cwd unknown /proc/31445/task/34028/cwd (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34028 mgr-fin ceph rtd unknown /proc/31445/task/34028/root (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34028 mgr-fin ceph txt unknown /proc/31445/task/34028/exe (readlink: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34028 mgr-fin ceph NOFD /proc/31445/task/34028/fd (opendir: Permission denied) 2024-09-21T07:08:34.709 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34029 mgr-fin ceph cwd unknown /proc/31445/task/34029/cwd (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34029 mgr-fin ceph rtd unknown /proc/31445/task/34029/root (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34029 mgr-fin ceph txt unknown /proc/31445/task/34029/exe (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34029 mgr-fin ceph NOFD /proc/31445/task/34029/fd (opendir: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34030 mgr-fin ceph cwd unknown /proc/31445/task/34030/cwd (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34030 mgr-fin ceph rtd unknown /proc/31445/task/34030/root (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34030 mgr-fin ceph txt unknown /proc/31445/task/34030/exe (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34030 mgr-fin ceph NOFD /proc/31445/task/34030/fd (opendir: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34031 mgr-fin ceph cwd unknown /proc/31445/task/34031/cwd (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34031 mgr-fin ceph rtd unknown /proc/31445/task/34031/root (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34031 mgr-fin ceph txt unknown /proc/31445/task/34031/exe (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34031 mgr-fin ceph NOFD /proc/31445/task/34031/fd (opendir: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34032 mgr-fin ceph cwd unknown /proc/31445/task/34032/cwd (readlink: Permission denied) 2024-09-21T07:08:34.710 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34032 mgr-fin ceph rtd unknown /proc/31445/task/34032/root (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34032 mgr-fin ceph txt unknown /proc/31445/task/34032/exe (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34032 mgr-fin ceph NOFD /proc/31445/task/34032/fd (opendir: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34033 mgr-fin ceph cwd unknown /proc/31445/task/34033/cwd (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34033 mgr-fin ceph rtd unknown /proc/31445/task/34033/root (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34033 mgr-fin ceph txt unknown /proc/31445/task/34033/exe (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34033 mgr-fin ceph NOFD /proc/31445/task/34033/fd (opendir: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34034 mgr-fin ceph cwd unknown /proc/31445/task/34034/cwd (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34034 mgr-fin ceph rtd unknown /proc/31445/task/34034/root (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34034 mgr-fin ceph txt unknown /proc/31445/task/34034/exe (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34034 mgr-fin ceph NOFD /proc/31445/task/34034/fd (opendir: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34035 mgr-fin ceph cwd unknown /proc/31445/task/34035/cwd (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34035 mgr-fin ceph rtd unknown /proc/31445/task/34035/root (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34035 mgr-fin ceph txt unknown /proc/31445/task/34035/exe (readlink: Permission denied) 2024-09-21T07:08:34.711 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34035 mgr-fin ceph NOFD /proc/31445/task/34035/fd (opendir: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34036 mgr-fin ceph cwd unknown /proc/31445/task/34036/cwd (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34036 mgr-fin ceph rtd unknown /proc/31445/task/34036/root (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34036 mgr-fin ceph txt unknown /proc/31445/task/34036/exe (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34036 mgr-fin ceph NOFD /proc/31445/task/34036/fd (opendir: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34073 mgr-fin ceph cwd unknown /proc/31445/task/34073/cwd (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34073 mgr-fin ceph rtd unknown /proc/31445/task/34073/root (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34073 mgr-fin ceph txt unknown /proc/31445/task/34073/exe (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34073 mgr-fin ceph NOFD /proc/31445/task/34073/fd (opendir: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34074 mgr-fin ceph cwd unknown /proc/31445/task/34074/cwd (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34074 mgr-fin ceph rtd unknown /proc/31445/task/34074/root (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34074 mgr-fin ceph txt unknown /proc/31445/task/34074/exe (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34074 mgr-fin ceph NOFD /proc/31445/task/34074/fd (opendir: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34075 mgr-fin ceph cwd unknown /proc/31445/task/34075/cwd (readlink: Permission denied) 2024-09-21T07:08:34.712 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34075 mgr-fin ceph rtd unknown /proc/31445/task/34075/root (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34075 mgr-fin ceph txt unknown /proc/31445/task/34075/exe (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34075 mgr-fin ceph NOFD /proc/31445/task/34075/fd (opendir: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34076 mgr-fin ceph cwd unknown /proc/31445/task/34076/cwd (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34076 mgr-fin ceph rtd unknown /proc/31445/task/34076/root (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34076 mgr-fin ceph txt unknown /proc/31445/task/34076/exe (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34076 mgr-fin ceph NOFD /proc/31445/task/34076/fd (opendir: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34077 mgr-fin ceph cwd unknown /proc/31445/task/34077/cwd (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34077 mgr-fin ceph rtd unknown /proc/31445/task/34077/root (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34077 mgr-fin ceph txt unknown /proc/31445/task/34077/exe (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34077 mgr-fin ceph NOFD /proc/31445/task/34077/fd (opendir: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34078 mgr-fin ceph cwd unknown /proc/31445/task/34078/cwd (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34078 mgr-fin ceph rtd unknown /proc/31445/task/34078/root (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34078 mgr-fin ceph txt unknown /proc/31445/task/34078/exe (readlink: Permission denied) 2024-09-21T07:08:34.713 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34078 mgr-fin ceph NOFD /proc/31445/task/34078/fd (opendir: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34079 mgr-fin ceph cwd unknown /proc/31445/task/34079/cwd (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34079 mgr-fin ceph rtd unknown /proc/31445/task/34079/root (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34079 mgr-fin ceph txt unknown /proc/31445/task/34079/exe (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34079 mgr-fin ceph NOFD /proc/31445/task/34079/fd (opendir: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34081 mgr-fin ceph cwd unknown /proc/31445/task/34081/cwd (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34081 mgr-fin ceph rtd unknown /proc/31445/task/34081/root (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34081 mgr-fin ceph txt unknown /proc/31445/task/34081/exe (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34081 mgr-fin ceph NOFD /proc/31445/task/34081/fd (opendir: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34082 mgr-fin ceph cwd unknown /proc/31445/task/34082/cwd (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34082 mgr-fin ceph rtd unknown /proc/31445/task/34082/root (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34082 mgr-fin ceph txt unknown /proc/31445/task/34082/exe (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34082 mgr-fin ceph NOFD /proc/31445/task/34082/fd (opendir: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34083 mgr-fin ceph cwd unknown /proc/31445/task/34083/cwd (readlink: Permission denied) 2024-09-21T07:08:34.714 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34083 mgr-fin ceph rtd unknown /proc/31445/task/34083/root (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34083 mgr-fin ceph txt unknown /proc/31445/task/34083/exe (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34083 mgr-fin ceph NOFD /proc/31445/task/34083/fd (opendir: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34084 mgr-fin ceph cwd unknown /proc/31445/task/34084/cwd (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34084 mgr-fin ceph rtd unknown /proc/31445/task/34084/root (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34084 mgr-fin ceph txt unknown /proc/31445/task/34084/exe (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34084 mgr-fin ceph NOFD /proc/31445/task/34084/fd (opendir: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34526 dashboard ceph cwd unknown /proc/31445/task/34526/cwd (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34526 dashboard ceph rtd unknown /proc/31445/task/34526/root (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34526 dashboard ceph txt unknown /proc/31445/task/34526/exe (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34526 dashboard ceph NOFD /proc/31445/task/34526/fd (opendir: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34527 dashboard ceph cwd unknown /proc/31445/task/34527/cwd (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34527 dashboard ceph rtd unknown /proc/31445/task/34527/root (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34527 dashboard ceph txt unknown /proc/31445/task/34527/exe (readlink: Permission denied) 2024-09-21T07:08:34.715 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34527 dashboard ceph NOFD /proc/31445/task/34527/fd (opendir: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34528 dashboard ceph cwd unknown /proc/31445/task/34528/cwd (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34528 dashboard ceph rtd unknown /proc/31445/task/34528/root (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34528 dashboard ceph txt unknown /proc/31445/task/34528/exe (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34528 dashboard ceph NOFD /proc/31445/task/34528/fd (opendir: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34529 dashboard ceph cwd unknown /proc/31445/task/34529/cwd (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34529 dashboard ceph rtd unknown /proc/31445/task/34529/root (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34529 dashboard ceph txt unknown /proc/31445/task/34529/exe (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34529 dashboard ceph NOFD /proc/31445/task/34529/fd (opendir: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34530 dashboard ceph cwd unknown /proc/31445/task/34530/cwd (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34530 dashboard ceph rtd unknown /proc/31445/task/34530/root (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34530 dashboard ceph txt unknown /proc/31445/task/34530/exe (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34530 dashboard ceph NOFD /proc/31445/task/34530/fd (opendir: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34531 dashboard ceph cwd unknown /proc/31445/task/34531/cwd (readlink: Permission denied) 2024-09-21T07:08:34.716 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34531 dashboard ceph rtd unknown /proc/31445/task/34531/root (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34531 dashboard ceph txt unknown /proc/31445/task/34531/exe (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34531 dashboard ceph NOFD /proc/31445/task/34531/fd (opendir: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34532 dashboard ceph cwd unknown /proc/31445/task/34532/cwd (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34532 dashboard ceph rtd unknown /proc/31445/task/34532/root (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34532 dashboard ceph txt unknown /proc/31445/task/34532/exe (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34532 dashboard ceph NOFD /proc/31445/task/34532/fd (opendir: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34533 dashboard ceph cwd unknown /proc/31445/task/34533/cwd (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34533 dashboard ceph rtd unknown /proc/31445/task/34533/root (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34533 dashboard ceph txt unknown /proc/31445/task/34533/exe (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34533 dashboard ceph NOFD /proc/31445/task/34533/fd (opendir: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34534 dashboard ceph cwd unknown /proc/31445/task/34534/cwd (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34534 dashboard ceph rtd unknown /proc/31445/task/34534/root (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34534 dashboard ceph txt unknown /proc/31445/task/34534/exe (readlink: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34534 dashboard ceph NOFD /proc/31445/task/34534/fd (opendir: Permission denied) 2024-09-21T07:08:34.717 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34535 dashboard ceph cwd unknown /proc/31445/task/34535/cwd (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34535 dashboard ceph rtd unknown /proc/31445/task/34535/root (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34535 dashboard ceph txt unknown /proc/31445/task/34535/exe (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34535 dashboard ceph NOFD /proc/31445/task/34535/fd (opendir: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34536 dashboard ceph cwd unknown /proc/31445/task/34536/cwd (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34536 dashboard ceph rtd unknown /proc/31445/task/34536/root (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34536 dashboard ceph txt unknown /proc/31445/task/34536/exe (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34536 dashboard ceph NOFD /proc/31445/task/34536/fd (opendir: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34538 dashboard ceph cwd unknown /proc/31445/task/34538/cwd (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34538 dashboard ceph rtd unknown /proc/31445/task/34538/root (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34538 dashboard ceph txt unknown /proc/31445/task/34538/exe (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 34538 dashboard ceph NOFD /proc/31445/task/34538/fd (opendir: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50907 devicehea ceph cwd unknown /proc/31445/task/50907/cwd (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50907 devicehea ceph rtd unknown /proc/31445/task/50907/root (readlink: Permission denied) 2024-09-21T07:08:34.718 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50907 devicehea ceph txt unknown /proc/31445/task/50907/exe (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50907 devicehea ceph NOFD /proc/31445/task/50907/fd (opendir: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50913 io_contex ceph cwd unknown /proc/31445/task/50913/cwd (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50913 io_contex ceph rtd unknown /proc/31445/task/50913/root (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50913 io_contex ceph txt unknown /proc/31445/task/50913/exe (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50913 io_contex ceph NOFD /proc/31445/task/50913/fd (opendir: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50914 io_contex ceph cwd unknown /proc/31445/task/50914/cwd (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50914 io_contex ceph rtd unknown /proc/31445/task/50914/root (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50914 io_contex ceph txt unknown /proc/31445/task/50914/exe (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50914 io_contex ceph NOFD /proc/31445/task/50914/fd (opendir: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50915 ceph_time ceph cwd unknown /proc/31445/task/50915/cwd (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50915 ceph_time ceph rtd unknown /proc/31445/task/50915/root (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50915 ceph_time ceph txt unknown /proc/31445/task/50915/exe (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50915 ceph_time ceph NOFD /proc/31445/task/50915/fd (opendir: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50916 ms_dispat ceph cwd unknown /proc/31445/task/50916/cwd (readlink: Permission denied) 2024-09-21T07:08:34.719 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50916 ms_dispat ceph rtd unknown /proc/31445/task/50916/root (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50916 ms_dispat ceph txt unknown /proc/31445/task/50916/exe (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50916 ms_dispat ceph NOFD /proc/31445/task/50916/fd (opendir: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50917 ms_local ceph cwd unknown /proc/31445/task/50917/cwd (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50917 ms_local ceph rtd unknown /proc/31445/task/50917/root (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50917 ms_local ceph txt unknown /proc/31445/task/50917/exe (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50917 ms_local ceph NOFD /proc/31445/task/50917/fd (opendir: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50918 safe_time ceph cwd unknown /proc/31445/task/50918/cwd (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50918 safe_time ceph rtd unknown /proc/31445/task/50918/root (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50918 safe_time ceph txt unknown /proc/31445/task/50918/exe (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50918 safe_time ceph NOFD /proc/31445/task/50918/fd (opendir: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50919 safe_time ceph cwd unknown /proc/31445/task/50919/cwd (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50919 safe_time ceph rtd unknown /proc/31445/task/50919/root (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50919 safe_time ceph txt unknown /proc/31445/task/50919/exe (readlink: Permission denied) 2024-09-21T07:08:34.720 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mgr 31445 50919 safe_time ceph NOFD /proc/31445/task/50919/fd (opendir: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 32454 root cwd unknown /proc/32454/cwd (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 32454 root rtd unknown /proc/32454/root (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 32454 root txt unknown /proc/32454/exe (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:systemd 32454 root NOFD /proc/32454/fd (opendir: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 32456 root cwd unknown /proc/32456/cwd (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 32456 root rtd unknown /proc/32456/root (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 32456 root txt unknown /proc/32456/exe (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:(sd-pam) 32456 root NOFD /proc/32456/fd (opendir: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33762 root cwd unknown /proc/33762/cwd (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33762 root rtd unknown /proc/33762/root (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33762 root txt unknown /proc/33762/exe (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33762 root NOFD /proc/33762/fd (opendir: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33765 root cwd unknown /proc/33765/cwd (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33765 root rtd unknown /proc/33765/root (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33765 root txt unknown /proc/33765/exe (readlink: Permission denied) 2024-09-21T07:08:34.721 INFO:tasks.workunit.client.0.smithi028.stdout:sshd 33765 root NOFD /proc/33765/fd (opendir: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 37125 root cwd unknown /proc/37125/cwd (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 37125 root rtd unknown /proc/37125/root (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 37125 root txt unknown /proc/37125/exe (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 37125 root NOFD /proc/37125/fd (opendir: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 40115 root cwd unknown /proc/40115/cwd (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 40115 root rtd unknown /proc/40115/root (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 40115 root txt unknown /proc/40115/exe (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 40115 root NOFD /proc/40115/fd (opendir: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 42666 root cwd unknown /proc/42666/cwd (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 42666 root rtd unknown /proc/42666/root (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 42666 root txt unknown /proc/42666/exe (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/3 42666 root NOFD /proc/42666/fd (opendir: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 42709 root cwd unknown /proc/42709/cwd (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 42709 root rtd unknown /proc/42709/root (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 42709 root txt unknown /proc/42709/exe (readlink: Permission denied) 2024-09-21T07:08:34.722 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 42709 root NOFD /proc/42709/fd (opendir: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 46634 root cwd unknown /proc/46634/cwd (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 46634 root rtd unknown /proc/46634/root (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 46634 root txt unknown /proc/46634/exe (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 46634 root NOFD /proc/46634/fd (opendir: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 46636 root cwd unknown /proc/46636/cwd (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 46636 root rtd unknown /proc/46636/root (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 46636 root txt unknown /proc/46636/exe (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 46636 root NOFD /proc/46636/fd (opendir: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 ceph cwd unknown /proc/46638/cwd (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 ceph rtd unknown /proc/46638/root (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 ceph txt unknown /proc/46638/exe (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 ceph NOFD /proc/46638/fd (opendir: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46639 log ceph cwd unknown /proc/46638/task/46639/cwd (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46639 log ceph rtd unknown /proc/46638/task/46639/root (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46639 log ceph txt unknown /proc/46638/task/46639/exe (readlink: Permission denied) 2024-09-21T07:08:34.723 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46639 log ceph NOFD /proc/46638/task/46639/fd (opendir: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46641 msgr-work ceph cwd unknown /proc/46638/task/46641/cwd (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46641 msgr-work ceph rtd unknown /proc/46638/task/46641/root (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46641 msgr-work ceph txt unknown /proc/46638/task/46641/exe (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46641 msgr-work ceph NOFD /proc/46638/task/46641/fd (opendir: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46642 msgr-work ceph cwd unknown /proc/46638/task/46642/cwd (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46642 msgr-work ceph rtd unknown /proc/46638/task/46642/root (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46642 msgr-work ceph txt unknown /proc/46638/task/46642/exe (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46642 msgr-work ceph NOFD /proc/46638/task/46642/fd (opendir: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46643 msgr-work ceph cwd unknown /proc/46638/task/46643/cwd (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46643 msgr-work ceph rtd unknown /proc/46638/task/46643/root (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46643 msgr-work ceph txt unknown /proc/46638/task/46643/exe (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46643 msgr-work ceph NOFD /proc/46638/task/46643/fd (opendir: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46647 service ceph cwd unknown /proc/46638/task/46647/cwd (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46647 service ceph rtd unknown /proc/46638/task/46647/root (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46647 service ceph txt unknown /proc/46638/task/46647/exe (readlink: Permission denied) 2024-09-21T07:08:34.724 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46647 service ceph NOFD /proc/46638/task/46647/fd (opendir: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46648 admin_soc ceph cwd unknown /proc/46638/task/46648/cwd (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46648 admin_soc ceph rtd unknown /proc/46638/task/46648/root (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46648 admin_soc ceph txt unknown /proc/46638/task/46648/exe (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46648 admin_soc ceph NOFD /proc/46638/task/46648/fd (opendir: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46901 signal_ha ceph cwd unknown /proc/46638/task/46901/cwd (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46901 signal_ha ceph rtd unknown /proc/46638/task/46901/root (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46901 signal_ha ceph txt unknown /proc/46638/task/46901/exe (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46901 signal_ha ceph NOFD /proc/46638/task/46901/fd (opendir: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46902 io_contex ceph cwd unknown /proc/46638/task/46902/cwd (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46902 io_contex ceph rtd unknown /proc/46638/task/46902/root (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46902 io_contex ceph txt unknown /proc/46638/task/46902/exe (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46902 io_contex ceph NOFD /proc/46638/task/46902/fd (opendir: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46903 io_contex ceph cwd unknown /proc/46638/task/46903/cwd (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46903 io_contex ceph rtd unknown /proc/46638/task/46903/root (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46903 io_contex ceph txt unknown /proc/46638/task/46903/exe (readlink: Permission denied) 2024-09-21T07:08:34.725 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46903 io_contex ceph NOFD /proc/46638/task/46903/fd (opendir: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46927 OpHistory ceph cwd unknown /proc/46638/task/46927/cwd (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46927 OpHistory ceph rtd unknown /proc/46638/task/46927/root (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46927 OpHistory ceph txt unknown /proc/46638/task/46927/exe (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46927 OpHistory ceph NOFD /proc/46638/task/46927/fd (opendir: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46928 ceph_time ceph cwd unknown /proc/46638/task/46928/cwd (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46928 ceph_time ceph rtd unknown /proc/46638/task/46928/root (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46928 ceph_time ceph txt unknown /proc/46638/task/46928/exe (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46928 ceph_time ceph NOFD /proc/46638/task/46928/fd (opendir: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46949 ceph-osd ceph cwd unknown /proc/46638/task/46949/cwd (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46949 ceph-osd ceph rtd unknown /proc/46638/task/46949/root (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46949 ceph-osd ceph txt unknown /proc/46638/task/46949/exe (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46949 ceph-osd ceph NOFD /proc/46638/task/46949/fd (opendir: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46965 ceph-osd ceph cwd unknown /proc/46638/task/46965/cwd (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46965 ceph-osd ceph rtd unknown /proc/46638/task/46965/root (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46965 ceph-osd ceph txt unknown /proc/46638/task/46965/exe (readlink: Permission denied) 2024-09-21T07:08:34.726 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 46965 ceph-osd ceph NOFD /proc/46638/task/46965/fd (opendir: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47024 ceph-osd ceph cwd unknown /proc/46638/task/47024/cwd (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47024 ceph-osd ceph rtd unknown /proc/46638/task/47024/root (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47024 ceph-osd ceph txt unknown /proc/46638/task/47024/exe (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47024 ceph-osd ceph NOFD /proc/46638/task/47024/fd (opendir: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47034 ceph-osd ceph cwd unknown /proc/46638/task/47034/cwd (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47034 ceph-osd ceph rtd unknown /proc/46638/task/47034/root (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47034 ceph-osd ceph txt unknown /proc/46638/task/47034/exe (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47034 ceph-osd ceph NOFD /proc/46638/task/47034/fd (opendir: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47045 ceph-osd ceph cwd unknown /proc/46638/task/47045/cwd (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47045 ceph-osd ceph rtd unknown /proc/46638/task/47045/root (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47045 ceph-osd ceph txt unknown /proc/46638/task/47045/exe (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47045 ceph-osd ceph NOFD /proc/46638/task/47045/fd (opendir: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47067 ceph-osd ceph cwd unknown /proc/46638/task/47067/cwd (readlink: Permission denied) 2024-09-21T07:08:34.727 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47067 ceph-osd ceph rtd unknown /proc/46638/task/47067/root (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47067 ceph-osd ceph txt unknown /proc/46638/task/47067/exe (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47067 ceph-osd ceph NOFD /proc/46638/task/47067/fd (opendir: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47071 ceph-osd ceph cwd unknown /proc/46638/task/47071/cwd (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47071 ceph-osd ceph rtd unknown /proc/46638/task/47071/root (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47071 ceph-osd ceph txt unknown /proc/46638/task/47071/exe (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47071 ceph-osd ceph NOFD /proc/46638/task/47071/fd (opendir: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47076 ceph-osd ceph cwd unknown /proc/46638/task/47076/cwd (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47076 ceph-osd ceph rtd unknown /proc/46638/task/47076/root (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47076 ceph-osd ceph txt unknown /proc/46638/task/47076/exe (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47076 ceph-osd ceph NOFD /proc/46638/task/47076/fd (opendir: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47077 ceph-osd ceph cwd unknown /proc/46638/task/47077/cwd (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47077 ceph-osd ceph rtd unknown /proc/46638/task/47077/root (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47077 ceph-osd ceph txt unknown /proc/46638/task/47077/exe (readlink: Permission denied) 2024-09-21T07:08:34.728 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47077 ceph-osd ceph NOFD /proc/46638/task/47077/fd (opendir: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47078 safe_time ceph cwd unknown /proc/46638/task/47078/cwd (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47078 safe_time ceph rtd unknown /proc/46638/task/47078/root (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47078 safe_time ceph txt unknown /proc/46638/task/47078/exe (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47078 safe_time ceph NOFD /proc/46638/task/47078/fd (opendir: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47079 safe_time ceph cwd unknown /proc/46638/task/47079/cwd (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47079 safe_time ceph rtd unknown /proc/46638/task/47079/root (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47079 safe_time ceph txt unknown /proc/46638/task/47079/exe (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47079 safe_time ceph NOFD /proc/46638/task/47079/fd (opendir: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47080 safe_time ceph cwd unknown /proc/46638/task/47080/cwd (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47080 safe_time ceph rtd unknown /proc/46638/task/47080/root (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47080 safe_time ceph txt unknown /proc/46638/task/47080/exe (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47080 safe_time ceph NOFD /proc/46638/task/47080/fd (opendir: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47081 safe_time ceph cwd unknown /proc/46638/task/47081/cwd (readlink: Permission denied) 2024-09-21T07:08:34.729 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47081 safe_time ceph rtd unknown /proc/46638/task/47081/root (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47081 safe_time ceph txt unknown /proc/46638/task/47081/exe (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47081 safe_time ceph NOFD /proc/46638/task/47081/fd (opendir: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47082 fn_anonym ceph cwd unknown /proc/46638/task/47082/cwd (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47082 fn_anonym ceph rtd unknown /proc/46638/task/47082/root (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47082 fn_anonym ceph txt unknown /proc/46638/task/47082/exe (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47082 fn_anonym ceph NOFD /proc/46638/task/47082/fd (opendir: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47154 rocksdb:l ceph cwd unknown /proc/46638/task/47154/cwd (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47154 rocksdb:l ceph rtd unknown /proc/46638/task/47154/root (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47154 rocksdb:l ceph txt unknown /proc/46638/task/47154/exe (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47154 rocksdb:l ceph NOFD /proc/46638/task/47154/fd (opendir: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47155 rocksdb:l ceph cwd unknown /proc/46638/task/47155/cwd (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47155 rocksdb:l ceph rtd unknown /proc/46638/task/47155/root (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47155 rocksdb:l ceph txt unknown /proc/46638/task/47155/exe (readlink: Permission denied) 2024-09-21T07:08:34.730 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47155 rocksdb:l ceph NOFD /proc/46638/task/47155/fd (opendir: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47156 rocksdb:l ceph cwd unknown /proc/46638/task/47156/cwd (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47156 rocksdb:l ceph rtd unknown /proc/46638/task/47156/root (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47156 rocksdb:l ceph txt unknown /proc/46638/task/47156/exe (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47156 rocksdb:l ceph NOFD /proc/46638/task/47156/fd (opendir: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47157 rocksdb:h ceph cwd unknown /proc/46638/task/47157/cwd (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47157 rocksdb:h ceph rtd unknown /proc/46638/task/47157/root (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47157 rocksdb:h ceph txt unknown /proc/46638/task/47157/exe (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47157 rocksdb:h ceph NOFD /proc/46638/task/47157/fd (opendir: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47615 bstore_ai ceph cwd unknown /proc/46638/task/47615/cwd (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47615 bstore_ai ceph rtd unknown /proc/46638/task/47615/root (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47615 bstore_ai ceph txt unknown /proc/46638/task/47615/exe (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47615 bstore_ai ceph NOFD /proc/46638/task/47615/fd (opendir: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47819 bstore_ai ceph cwd unknown /proc/46638/task/47819/cwd (readlink: Permission denied) 2024-09-21T07:08:34.731 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47819 bstore_ai ceph rtd unknown /proc/46638/task/47819/root (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47819 bstore_ai ceph txt unknown /proc/46638/task/47819/exe (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 47819 bstore_ai ceph NOFD /proc/46638/task/47819/fd (opendir: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48004 ceph-osd ceph cwd unknown /proc/46638/task/48004/cwd (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48004 ceph-osd ceph rtd unknown /proc/46638/task/48004/root (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48004 ceph-osd ceph txt unknown /proc/46638/task/48004/exe (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48004 ceph-osd ceph NOFD /proc/46638/task/48004/fd (opendir: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48005 cfin ceph cwd unknown /proc/46638/task/48005/cwd (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48005 cfin ceph rtd unknown /proc/46638/task/48005/root (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48005 cfin ceph txt unknown /proc/46638/task/48005/exe (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48005 cfin ceph NOFD /proc/46638/task/48005/fd (opendir: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48006 bstore_kv ceph cwd unknown /proc/46638/task/48006/cwd (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48006 bstore_kv ceph rtd unknown /proc/46638/task/48006/root (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48006 bstore_kv ceph txt unknown /proc/46638/task/48006/exe (readlink: Permission denied) 2024-09-21T07:08:34.732 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48006 bstore_kv ceph NOFD /proc/46638/task/48006/fd (opendir: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48007 bstore_kv ceph cwd unknown /proc/46638/task/48007/cwd (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48007 bstore_kv ceph rtd unknown /proc/46638/task/48007/root (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48007 bstore_kv ceph txt unknown /proc/46638/task/48007/exe (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48007 bstore_kv ceph NOFD /proc/46638/task/48007/fd (opendir: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48008 bstore_me ceph cwd unknown /proc/46638/task/48008/cwd (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48008 bstore_me ceph rtd unknown /proc/46638/task/48008/root (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48008 bstore_me ceph txt unknown /proc/46638/task/48008/exe (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48008 bstore_me ceph NOFD /proc/46638/task/48008/fd (opendir: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48009 ms_dispat ceph cwd unknown /proc/46638/task/48009/cwd (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48009 ms_dispat ceph rtd unknown /proc/46638/task/48009/root (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48009 ms_dispat ceph txt unknown /proc/46638/task/48009/exe (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48009 ms_dispat ceph NOFD /proc/46638/task/48009/fd (opendir: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48010 ms_local ceph cwd unknown /proc/46638/task/48010/cwd (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48010 ms_local ceph rtd unknown /proc/46638/task/48010/root (readlink: Permission denied) 2024-09-21T07:08:34.733 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48010 ms_local ceph txt unknown /proc/46638/task/48010/exe (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48010 ms_local ceph NOFD /proc/46638/task/48010/fd (opendir: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48011 safe_time ceph cwd unknown /proc/46638/task/48011/cwd (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48011 safe_time ceph rtd unknown /proc/46638/task/48011/root (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48011 safe_time ceph txt unknown /proc/46638/task/48011/exe (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48011 safe_time ceph NOFD /proc/46638/task/48011/fd (opendir: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48012 safe_time ceph cwd unknown /proc/46638/task/48012/cwd (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48012 safe_time ceph rtd unknown /proc/46638/task/48012/root (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48012 safe_time ceph txt unknown /proc/46638/task/48012/exe (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48012 safe_time ceph NOFD /proc/46638/task/48012/fd (opendir: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48013 ms_dispat ceph cwd unknown /proc/46638/task/48013/cwd (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48013 ms_dispat ceph rtd unknown /proc/46638/task/48013/root (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48013 ms_dispat ceph txt unknown /proc/46638/task/48013/exe (readlink: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48013 ms_dispat ceph NOFD /proc/46638/task/48013/fd (opendir: Permission denied) 2024-09-21T07:08:34.734 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48014 ms_local ceph cwd unknown /proc/46638/task/48014/cwd (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48014 ms_local ceph rtd unknown /proc/46638/task/48014/root (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48014 ms_local ceph txt unknown /proc/46638/task/48014/exe (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48014 ms_local ceph NOFD /proc/46638/task/48014/fd (opendir: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48015 ms_dispat ceph cwd unknown /proc/46638/task/48015/cwd (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48015 ms_dispat ceph rtd unknown /proc/46638/task/48015/root (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48015 ms_dispat ceph txt unknown /proc/46638/task/48015/exe (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48015 ms_dispat ceph NOFD /proc/46638/task/48015/fd (opendir: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48016 ms_local ceph cwd unknown /proc/46638/task/48016/cwd (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48016 ms_local ceph rtd unknown /proc/46638/task/48016/root (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48016 ms_local ceph txt unknown /proc/46638/task/48016/exe (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48016 ms_local ceph NOFD /proc/46638/task/48016/fd (opendir: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48017 ms_dispat ceph cwd unknown /proc/46638/task/48017/cwd (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48017 ms_dispat ceph rtd unknown /proc/46638/task/48017/root (readlink: Permission denied) 2024-09-21T07:08:34.735 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48017 ms_dispat ceph txt unknown /proc/46638/task/48017/exe (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48017 ms_dispat ceph NOFD /proc/46638/task/48017/fd (opendir: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48018 ms_local ceph cwd unknown /proc/46638/task/48018/cwd (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48018 ms_local ceph rtd unknown /proc/46638/task/48018/root (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48018 ms_local ceph txt unknown /proc/46638/task/48018/exe (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48018 ms_local ceph NOFD /proc/46638/task/48018/fd (opendir: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48019 ms_dispat ceph cwd unknown /proc/46638/task/48019/cwd (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48019 ms_dispat ceph rtd unknown /proc/46638/task/48019/root (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48019 ms_dispat ceph txt unknown /proc/46638/task/48019/exe (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48019 ms_dispat ceph NOFD /proc/46638/task/48019/fd (opendir: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48020 ms_local ceph cwd unknown /proc/46638/task/48020/cwd (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48020 ms_local ceph rtd unknown /proc/46638/task/48020/root (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48020 ms_local ceph txt unknown /proc/46638/task/48020/exe (readlink: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48020 ms_local ceph NOFD /proc/46638/task/48020/fd (opendir: Permission denied) 2024-09-21T07:08:34.736 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48021 ms_dispat ceph cwd unknown /proc/46638/task/48021/cwd (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48021 ms_dispat ceph rtd unknown /proc/46638/task/48021/root (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48021 ms_dispat ceph txt unknown /proc/46638/task/48021/exe (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48021 ms_dispat ceph NOFD /proc/46638/task/48021/fd (opendir: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48022 ms_local ceph cwd unknown /proc/46638/task/48022/cwd (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48022 ms_local ceph rtd unknown /proc/46638/task/48022/root (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48022 ms_local ceph txt unknown /proc/46638/task/48022/exe (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48022 ms_local ceph NOFD /proc/46638/task/48022/fd (opendir: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48023 ms_dispat ceph cwd unknown /proc/46638/task/48023/cwd (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48023 ms_dispat ceph rtd unknown /proc/46638/task/48023/root (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48023 ms_dispat ceph txt unknown /proc/46638/task/48023/exe (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48023 ms_dispat ceph NOFD /proc/46638/task/48023/fd (opendir: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48024 ms_local ceph cwd unknown /proc/46638/task/48024/cwd (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48024 ms_local ceph rtd unknown /proc/46638/task/48024/root (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48024 ms_local ceph txt unknown /proc/46638/task/48024/exe (readlink: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48024 ms_local ceph NOFD /proc/46638/task/48024/fd (opendir: Permission denied) 2024-09-21T07:08:34.737 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48025 fn_anonym ceph cwd unknown /proc/46638/task/48025/cwd (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48025 fn_anonym ceph rtd unknown /proc/46638/task/48025/root (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48025 fn_anonym ceph txt unknown /proc/46638/task/48025/exe (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48025 fn_anonym ceph NOFD /proc/46638/task/48025/fd (opendir: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48026 finisher ceph cwd unknown /proc/46638/task/48026/cwd (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48026 finisher ceph rtd unknown /proc/46638/task/48026/root (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48026 finisher ceph txt unknown /proc/46638/task/48026/exe (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48026 finisher ceph NOFD /proc/46638/task/48026/fd (opendir: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48027 safe_time ceph cwd unknown /proc/46638/task/48027/cwd (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48027 safe_time ceph rtd unknown /proc/46638/task/48027/root (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48027 safe_time ceph txt unknown /proc/46638/task/48027/exe (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48027 safe_time ceph NOFD /proc/46638/task/48027/fd (opendir: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48028 safe_time ceph cwd unknown /proc/46638/task/48028/cwd (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48028 safe_time ceph rtd unknown /proc/46638/task/48028/root (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48028 safe_time ceph txt unknown /proc/46638/task/48028/exe (readlink: Permission denied) 2024-09-21T07:08:34.738 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48028 safe_time ceph NOFD /proc/46638/task/48028/fd (opendir: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48029 ceph-osd ceph cwd unknown /proc/46638/task/48029/cwd (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48029 ceph-osd ceph rtd unknown /proc/46638/task/48029/root (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48029 ceph-osd ceph txt unknown /proc/46638/task/48029/exe (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48029 ceph-osd ceph NOFD /proc/46638/task/48029/fd (opendir: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48030 osd_srv_a ceph cwd unknown /proc/46638/task/48030/cwd (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48030 osd_srv_a ceph rtd unknown /proc/46638/task/48030/root (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48030 osd_srv_a ceph txt unknown /proc/46638/task/48030/exe (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48030 osd_srv_a ceph NOFD /proc/46638/task/48030/fd (opendir: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48031 tp_osd_tp ceph cwd unknown /proc/46638/task/48031/cwd (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48031 tp_osd_tp ceph rtd unknown /proc/46638/task/48031/root (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48031 tp_osd_tp ceph txt unknown /proc/46638/task/48031/exe (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48031 tp_osd_tp ceph NOFD /proc/46638/task/48031/fd (opendir: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48032 tp_osd_tp ceph cwd unknown /proc/46638/task/48032/cwd (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48032 tp_osd_tp ceph rtd unknown /proc/46638/task/48032/root (readlink: Permission denied) 2024-09-21T07:08:34.739 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48032 tp_osd_tp ceph txt unknown /proc/46638/task/48032/exe (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48032 tp_osd_tp ceph NOFD /proc/46638/task/48032/fd (opendir: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48033 tp_osd_tp ceph cwd unknown /proc/46638/task/48033/cwd (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48033 tp_osd_tp ceph rtd unknown /proc/46638/task/48033/root (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48033 tp_osd_tp ceph txt unknown /proc/46638/task/48033/exe (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48033 tp_osd_tp ceph NOFD /proc/46638/task/48033/fd (opendir: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48034 tp_osd_tp ceph cwd unknown /proc/46638/task/48034/cwd (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48034 tp_osd_tp ceph rtd unknown /proc/46638/task/48034/root (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48034 tp_osd_tp ceph txt unknown /proc/46638/task/48034/exe (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48034 tp_osd_tp ceph NOFD /proc/46638/task/48034/fd (opendir: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48035 tp_osd_tp ceph cwd unknown /proc/46638/task/48035/cwd (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48035 tp_osd_tp ceph rtd unknown /proc/46638/task/48035/root (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48035 tp_osd_tp ceph txt unknown /proc/46638/task/48035/exe (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48035 tp_osd_tp ceph NOFD /proc/46638/task/48035/fd (opendir: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48036 tp_osd_tp ceph cwd unknown /proc/46638/task/48036/cwd (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48036 tp_osd_tp ceph rtd unknown /proc/46638/task/48036/root (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48036 tp_osd_tp ceph txt unknown /proc/46638/task/48036/exe (readlink: Permission denied) 2024-09-21T07:08:34.740 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48036 tp_osd_tp ceph NOFD /proc/46638/task/48036/fd (opendir: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48037 tp_osd_tp ceph cwd unknown /proc/46638/task/48037/cwd (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48037 tp_osd_tp ceph rtd unknown /proc/46638/task/48037/root (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48037 tp_osd_tp ceph txt unknown /proc/46638/task/48037/exe (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48037 tp_osd_tp ceph NOFD /proc/46638/task/48037/fd (opendir: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48038 tp_osd_tp ceph cwd unknown /proc/46638/task/48038/cwd (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48038 tp_osd_tp ceph rtd unknown /proc/46638/task/48038/root (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48038 tp_osd_tp ceph txt unknown /proc/46638/task/48038/exe (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48038 tp_osd_tp ceph NOFD /proc/46638/task/48038/fd (opendir: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48039 tp_osd_tp ceph cwd unknown /proc/46638/task/48039/cwd (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48039 tp_osd_tp ceph rtd unknown /proc/46638/task/48039/root (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48039 tp_osd_tp ceph txt unknown /proc/46638/task/48039/exe (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48039 tp_osd_tp ceph NOFD /proc/46638/task/48039/fd (opendir: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48040 tp_osd_tp ceph cwd unknown /proc/46638/task/48040/cwd (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48040 tp_osd_tp ceph rtd unknown /proc/46638/task/48040/root (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48040 tp_osd_tp ceph txt unknown /proc/46638/task/48040/exe (readlink: Permission denied) 2024-09-21T07:08:34.741 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48040 tp_osd_tp ceph NOFD /proc/46638/task/48040/fd (opendir: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48041 tp_osd_tp ceph cwd unknown /proc/46638/task/48041/cwd (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48041 tp_osd_tp ceph rtd unknown /proc/46638/task/48041/root (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48041 tp_osd_tp ceph txt unknown /proc/46638/task/48041/exe (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48041 tp_osd_tp ceph NOFD /proc/46638/task/48041/fd (opendir: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48042 tp_osd_tp ceph cwd unknown /proc/46638/task/48042/cwd (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48042 tp_osd_tp ceph rtd unknown /proc/46638/task/48042/root (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48042 tp_osd_tp ceph txt unknown /proc/46638/task/48042/exe (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48042 tp_osd_tp ceph NOFD /proc/46638/task/48042/fd (opendir: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48043 tp_osd_tp ceph cwd unknown /proc/46638/task/48043/cwd (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48043 tp_osd_tp ceph rtd unknown /proc/46638/task/48043/root (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48043 tp_osd_tp ceph txt unknown /proc/46638/task/48043/exe (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48043 tp_osd_tp ceph NOFD /proc/46638/task/48043/fd (opendir: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48044 tp_osd_tp ceph cwd unknown /proc/46638/task/48044/cwd (readlink: Permission denied) 2024-09-21T07:08:34.742 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48044 tp_osd_tp ceph rtd unknown /proc/46638/task/48044/root (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48044 tp_osd_tp ceph txt unknown /proc/46638/task/48044/exe (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48044 tp_osd_tp ceph NOFD /proc/46638/task/48044/fd (opendir: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48045 tp_osd_tp ceph cwd unknown /proc/46638/task/48045/cwd (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48045 tp_osd_tp ceph rtd unknown /proc/46638/task/48045/root (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48045 tp_osd_tp ceph txt unknown /proc/46638/task/48045/exe (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48045 tp_osd_tp ceph NOFD /proc/46638/task/48045/fd (opendir: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48046 tp_osd_tp ceph cwd unknown /proc/46638/task/48046/cwd (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48046 tp_osd_tp ceph rtd unknown /proc/46638/task/48046/root (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48046 tp_osd_tp ceph txt unknown /proc/46638/task/48046/exe (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48046 tp_osd_tp ceph NOFD /proc/46638/task/48046/fd (opendir: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48047 osd_srv_h ceph cwd unknown /proc/46638/task/48047/cwd (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48047 osd_srv_h ceph rtd unknown /proc/46638/task/48047/root (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48047 osd_srv_h ceph txt unknown /proc/46638/task/48047/exe (readlink: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 46638 48047 osd_srv_h ceph NOFD /proc/46638/task/48047/fd (opendir: Permission denied) 2024-09-21T07:08:34.743 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 47340 root cwd unknown /proc/47340/cwd (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 47340 root rtd unknown /proc/47340/root (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 47340 root txt unknown /proc/47340/exe (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 47340 root NOFD /proc/47340/fd (opendir: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 47357 root cwd unknown /proc/47357/cwd (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 47357 root rtd unknown /proc/47357/root (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 47357 root txt unknown /proc/47357/exe (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 47357 root NOFD /proc/47357/fd (opendir: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 50829 root cwd unknown /proc/50829/cwd (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 50829 root rtd unknown /proc/50829/root (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 50829 root txt unknown /proc/50829/exe (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 50829 root NOFD /proc/50829/fd (opendir: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 52896 root cwd unknown /proc/52896/cwd (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 52896 root rtd unknown /proc/52896/root (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 52896 root txt unknown /proc/52896/exe (readlink: Permission denied) 2024-09-21T07:08:34.744 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 52896 root NOFD /proc/52896/fd (opendir: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 52898 root cwd unknown /proc/52898/cwd (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 52898 root rtd unknown /proc/52898/root (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 52898 root txt unknown /proc/52898/exe (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 52898 root NOFD /proc/52898/fd (opendir: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 ceph cwd unknown /proc/52900/cwd (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 ceph rtd unknown /proc/52900/root (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 ceph txt unknown /proc/52900/exe (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 ceph NOFD /proc/52900/fd (opendir: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52901 log ceph cwd unknown /proc/52900/task/52901/cwd (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52901 log ceph rtd unknown /proc/52900/task/52901/root (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52901 log ceph txt unknown /proc/52900/task/52901/exe (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52901 log ceph NOFD /proc/52900/task/52901/fd (opendir: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52903 msgr-work ceph cwd unknown /proc/52900/task/52903/cwd (readlink: Permission denied) 2024-09-21T07:08:34.745 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52903 msgr-work ceph rtd unknown /proc/52900/task/52903/root (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52903 msgr-work ceph txt unknown /proc/52900/task/52903/exe (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52903 msgr-work ceph NOFD /proc/52900/task/52903/fd (opendir: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52904 msgr-work ceph cwd unknown /proc/52900/task/52904/cwd (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52904 msgr-work ceph rtd unknown /proc/52900/task/52904/root (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52904 msgr-work ceph txt unknown /proc/52900/task/52904/exe (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52904 msgr-work ceph NOFD /proc/52900/task/52904/fd (opendir: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52905 msgr-work ceph cwd unknown /proc/52900/task/52905/cwd (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52905 msgr-work ceph rtd unknown /proc/52900/task/52905/root (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52905 msgr-work ceph txt unknown /proc/52900/task/52905/exe (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52905 msgr-work ceph NOFD /proc/52900/task/52905/fd (opendir: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52909 service ceph cwd unknown /proc/52900/task/52909/cwd (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52909 service ceph rtd unknown /proc/52900/task/52909/root (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52909 service ceph txt unknown /proc/52900/task/52909/exe (readlink: Permission denied) 2024-09-21T07:08:34.746 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52909 service ceph NOFD /proc/52900/task/52909/fd (opendir: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52910 admin_soc ceph cwd unknown /proc/52900/task/52910/cwd (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52910 admin_soc ceph rtd unknown /proc/52900/task/52910/root (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52910 admin_soc ceph txt unknown /proc/52900/task/52910/exe (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 52910 admin_soc ceph NOFD /proc/52900/task/52910/fd (opendir: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53179 signal_ha ceph cwd unknown /proc/52900/task/53179/cwd (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53179 signal_ha ceph rtd unknown /proc/52900/task/53179/root (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53179 signal_ha ceph txt unknown /proc/52900/task/53179/exe (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53179 signal_ha ceph NOFD /proc/52900/task/53179/fd (opendir: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53180 io_contex ceph cwd unknown /proc/52900/task/53180/cwd (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53180 io_contex ceph rtd unknown /proc/52900/task/53180/root (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53180 io_contex ceph txt unknown /proc/52900/task/53180/exe (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53180 io_contex ceph NOFD /proc/52900/task/53180/fd (opendir: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53181 io_contex ceph cwd unknown /proc/52900/task/53181/cwd (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53181 io_contex ceph rtd unknown /proc/52900/task/53181/root (readlink: Permission denied) 2024-09-21T07:08:34.747 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53181 io_contex ceph txt unknown /proc/52900/task/53181/exe (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53181 io_contex ceph NOFD /proc/52900/task/53181/fd (opendir: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53190 OpHistory ceph cwd unknown /proc/52900/task/53190/cwd (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53190 OpHistory ceph rtd unknown /proc/52900/task/53190/root (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53190 OpHistory ceph txt unknown /proc/52900/task/53190/exe (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53190 OpHistory ceph NOFD /proc/52900/task/53190/fd (opendir: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53191 ceph_time ceph cwd unknown /proc/52900/task/53191/cwd (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53191 ceph_time ceph rtd unknown /proc/52900/task/53191/root (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53191 ceph_time ceph txt unknown /proc/52900/task/53191/exe (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53191 ceph_time ceph NOFD /proc/52900/task/53191/fd (opendir: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53213 ceph-osd ceph cwd unknown /proc/52900/task/53213/cwd (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53213 ceph-osd ceph rtd unknown /proc/52900/task/53213/root (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53213 ceph-osd ceph txt unknown /proc/52900/task/53213/exe (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53213 ceph-osd ceph NOFD /proc/52900/task/53213/fd (opendir: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53229 ceph-osd ceph cwd unknown /proc/52900/task/53229/cwd (readlink: Permission denied) 2024-09-21T07:08:34.748 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53229 ceph-osd ceph rtd unknown /proc/52900/task/53229/root (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53229 ceph-osd ceph txt unknown /proc/52900/task/53229/exe (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53229 ceph-osd ceph NOFD /proc/52900/task/53229/fd (opendir: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53289 ceph-osd ceph cwd unknown /proc/52900/task/53289/cwd (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53289 ceph-osd ceph rtd unknown /proc/52900/task/53289/root (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53289 ceph-osd ceph txt unknown /proc/52900/task/53289/exe (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53289 ceph-osd ceph NOFD /proc/52900/task/53289/fd (opendir: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53317 ceph-osd ceph cwd unknown /proc/52900/task/53317/cwd (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53317 ceph-osd ceph rtd unknown /proc/52900/task/53317/root (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53317 ceph-osd ceph txt unknown /proc/52900/task/53317/exe (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53317 ceph-osd ceph NOFD /proc/52900/task/53317/fd (opendir: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53341 ceph-osd ceph cwd unknown /proc/52900/task/53341/cwd (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53341 ceph-osd ceph rtd unknown /proc/52900/task/53341/root (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53341 ceph-osd ceph txt unknown /proc/52900/task/53341/exe (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53341 ceph-osd ceph NOFD /proc/52900/task/53341/fd (opendir: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53346 ceph-osd ceph cwd unknown /proc/52900/task/53346/cwd (readlink: Permission denied) 2024-09-21T07:08:34.749 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53346 ceph-osd ceph rtd unknown /proc/52900/task/53346/root (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53346 ceph-osd ceph txt unknown /proc/52900/task/53346/exe (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53346 ceph-osd ceph NOFD /proc/52900/task/53346/fd (opendir: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53398 ceph-osd ceph cwd unknown /proc/52900/task/53398/cwd (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53398 ceph-osd ceph rtd unknown /proc/52900/task/53398/root (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53398 ceph-osd ceph txt unknown /proc/52900/task/53398/exe (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53398 ceph-osd ceph NOFD /proc/52900/task/53398/fd (opendir: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53427 ceph-osd ceph cwd unknown /proc/52900/task/53427/cwd (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53427 ceph-osd ceph rtd unknown /proc/52900/task/53427/root (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53427 ceph-osd ceph txt unknown /proc/52900/task/53427/exe (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53427 ceph-osd ceph NOFD /proc/52900/task/53427/fd (opendir: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53429 ceph-osd ceph cwd unknown /proc/52900/task/53429/cwd (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53429 ceph-osd ceph rtd unknown /proc/52900/task/53429/root (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53429 ceph-osd ceph txt unknown /proc/52900/task/53429/exe (readlink: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53429 ceph-osd ceph NOFD /proc/52900/task/53429/fd (opendir: Permission denied) 2024-09-21T07:08:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53430 safe_time ceph cwd unknown /proc/52900/task/53430/cwd (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53430 safe_time ceph rtd unknown /proc/52900/task/53430/root (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53430 safe_time ceph txt unknown /proc/52900/task/53430/exe (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53430 safe_time ceph NOFD /proc/52900/task/53430/fd (opendir: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53431 safe_time ceph cwd unknown /proc/52900/task/53431/cwd (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53431 safe_time ceph rtd unknown /proc/52900/task/53431/root (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53431 safe_time ceph txt unknown /proc/52900/task/53431/exe (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53431 safe_time ceph NOFD /proc/52900/task/53431/fd (opendir: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53432 safe_time ceph cwd unknown /proc/52900/task/53432/cwd (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53432 safe_time ceph rtd unknown /proc/52900/task/53432/root (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53432 safe_time ceph txt unknown /proc/52900/task/53432/exe (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53432 safe_time ceph NOFD /proc/52900/task/53432/fd (opendir: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53433 safe_time ceph cwd unknown /proc/52900/task/53433/cwd (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53433 safe_time ceph rtd unknown /proc/52900/task/53433/root (readlink: Permission denied) 2024-09-21T07:08:34.751 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53433 safe_time ceph txt unknown /proc/52900/task/53433/exe (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53433 safe_time ceph NOFD /proc/52900/task/53433/fd (opendir: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53434 fn_anonym ceph cwd unknown /proc/52900/task/53434/cwd (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53434 fn_anonym ceph rtd unknown /proc/52900/task/53434/root (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53434 fn_anonym ceph txt unknown /proc/52900/task/53434/exe (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53434 fn_anonym ceph NOFD /proc/52900/task/53434/fd (opendir: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53492 rocksdb:l ceph cwd unknown /proc/52900/task/53492/cwd (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53492 rocksdb:l ceph rtd unknown /proc/52900/task/53492/root (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53492 rocksdb:l ceph txt unknown /proc/52900/task/53492/exe (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53492 rocksdb:l ceph NOFD /proc/52900/task/53492/fd (opendir: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53493 rocksdb:l ceph cwd unknown /proc/52900/task/53493/cwd (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53493 rocksdb:l ceph rtd unknown /proc/52900/task/53493/root (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53493 rocksdb:l ceph txt unknown /proc/52900/task/53493/exe (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53493 rocksdb:l ceph NOFD /proc/52900/task/53493/fd (opendir: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53494 rocksdb:l ceph cwd unknown /proc/52900/task/53494/cwd (readlink: Permission denied) 2024-09-21T07:08:34.752 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53494 rocksdb:l ceph rtd unknown /proc/52900/task/53494/root (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53494 rocksdb:l ceph txt unknown /proc/52900/task/53494/exe (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53494 rocksdb:l ceph NOFD /proc/52900/task/53494/fd (opendir: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53495 rocksdb:h ceph cwd unknown /proc/52900/task/53495/cwd (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53495 rocksdb:h ceph rtd unknown /proc/52900/task/53495/root (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53495 rocksdb:h ceph txt unknown /proc/52900/task/53495/exe (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53495 rocksdb:h ceph NOFD /proc/52900/task/53495/fd (opendir: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53903 bstore_ai ceph cwd unknown /proc/52900/task/53903/cwd (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53903 bstore_ai ceph rtd unknown /proc/52900/task/53903/root (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53903 bstore_ai ceph txt unknown /proc/52900/task/53903/exe (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 53903 bstore_ai ceph NOFD /proc/52900/task/53903/fd (opendir: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54092 bstore_ai ceph cwd unknown /proc/52900/task/54092/cwd (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54092 bstore_ai ceph rtd unknown /proc/52900/task/54092/root (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54092 bstore_ai ceph txt unknown /proc/52900/task/54092/exe (readlink: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54092 bstore_ai ceph NOFD /proc/52900/task/54092/fd (opendir: Permission denied) 2024-09-21T07:08:34.753 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54274 ceph-osd ceph cwd unknown /proc/52900/task/54274/cwd (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54274 ceph-osd ceph rtd unknown /proc/52900/task/54274/root (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54274 ceph-osd ceph txt unknown /proc/52900/task/54274/exe (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54274 ceph-osd ceph NOFD /proc/52900/task/54274/fd (opendir: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54275 cfin ceph cwd unknown /proc/52900/task/54275/cwd (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54275 cfin ceph rtd unknown /proc/52900/task/54275/root (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54275 cfin ceph txt unknown /proc/52900/task/54275/exe (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54275 cfin ceph NOFD /proc/52900/task/54275/fd (opendir: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54276 bstore_kv ceph cwd unknown /proc/52900/task/54276/cwd (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54276 bstore_kv ceph rtd unknown /proc/52900/task/54276/root (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54276 bstore_kv ceph txt unknown /proc/52900/task/54276/exe (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54276 bstore_kv ceph NOFD /proc/52900/task/54276/fd (opendir: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54277 bstore_kv ceph cwd unknown /proc/52900/task/54277/cwd (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54277 bstore_kv ceph rtd unknown /proc/52900/task/54277/root (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54277 bstore_kv ceph txt unknown /proc/52900/task/54277/exe (readlink: Permission denied) 2024-09-21T07:08:34.754 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54277 bstore_kv ceph NOFD /proc/52900/task/54277/fd (opendir: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54278 bstore_me ceph cwd unknown /proc/52900/task/54278/cwd (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54278 bstore_me ceph rtd unknown /proc/52900/task/54278/root (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54278 bstore_me ceph txt unknown /proc/52900/task/54278/exe (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54278 bstore_me ceph NOFD /proc/52900/task/54278/fd (opendir: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54279 ms_dispat ceph cwd unknown /proc/52900/task/54279/cwd (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54279 ms_dispat ceph rtd unknown /proc/52900/task/54279/root (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54279 ms_dispat ceph txt unknown /proc/52900/task/54279/exe (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54279 ms_dispat ceph NOFD /proc/52900/task/54279/fd (opendir: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54280 ms_local ceph cwd unknown /proc/52900/task/54280/cwd (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54280 ms_local ceph rtd unknown /proc/52900/task/54280/root (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54280 ms_local ceph txt unknown /proc/52900/task/54280/exe (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54280 ms_local ceph NOFD /proc/52900/task/54280/fd (opendir: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54281 safe_time ceph cwd unknown /proc/52900/task/54281/cwd (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54281 safe_time ceph rtd unknown /proc/52900/task/54281/root (readlink: Permission denied) 2024-09-21T07:08:34.755 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54281 safe_time ceph txt unknown /proc/52900/task/54281/exe (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54281 safe_time ceph NOFD /proc/52900/task/54281/fd (opendir: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54282 safe_time ceph cwd unknown /proc/52900/task/54282/cwd (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54282 safe_time ceph rtd unknown /proc/52900/task/54282/root (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54282 safe_time ceph txt unknown /proc/52900/task/54282/exe (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54282 safe_time ceph NOFD /proc/52900/task/54282/fd (opendir: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54283 ms_dispat ceph cwd unknown /proc/52900/task/54283/cwd (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54283 ms_dispat ceph rtd unknown /proc/52900/task/54283/root (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54283 ms_dispat ceph txt unknown /proc/52900/task/54283/exe (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54283 ms_dispat ceph NOFD /proc/52900/task/54283/fd (opendir: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54284 ms_local ceph cwd unknown /proc/52900/task/54284/cwd (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54284 ms_local ceph rtd unknown /proc/52900/task/54284/root (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54284 ms_local ceph txt unknown /proc/52900/task/54284/exe (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54284 ms_local ceph NOFD /proc/52900/task/54284/fd (opendir: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54285 ms_dispat ceph cwd unknown /proc/52900/task/54285/cwd (readlink: Permission denied) 2024-09-21T07:08:34.756 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54285 ms_dispat ceph rtd unknown /proc/52900/task/54285/root (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54285 ms_dispat ceph txt unknown /proc/52900/task/54285/exe (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54285 ms_dispat ceph NOFD /proc/52900/task/54285/fd (opendir: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54286 ms_local ceph cwd unknown /proc/52900/task/54286/cwd (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54286 ms_local ceph rtd unknown /proc/52900/task/54286/root (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54286 ms_local ceph txt unknown /proc/52900/task/54286/exe (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54286 ms_local ceph NOFD /proc/52900/task/54286/fd (opendir: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54287 ms_dispat ceph cwd unknown /proc/52900/task/54287/cwd (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54287 ms_dispat ceph rtd unknown /proc/52900/task/54287/root (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54287 ms_dispat ceph txt unknown /proc/52900/task/54287/exe (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54287 ms_dispat ceph NOFD /proc/52900/task/54287/fd (opendir: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54288 ms_local ceph cwd unknown /proc/52900/task/54288/cwd (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54288 ms_local ceph rtd unknown /proc/52900/task/54288/root (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54288 ms_local ceph txt unknown /proc/52900/task/54288/exe (readlink: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54288 ms_local ceph NOFD /proc/52900/task/54288/fd (opendir: Permission denied) 2024-09-21T07:08:34.757 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54289 ms_dispat ceph cwd unknown /proc/52900/task/54289/cwd (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54289 ms_dispat ceph rtd unknown /proc/52900/task/54289/root (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54289 ms_dispat ceph txt unknown /proc/52900/task/54289/exe (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54289 ms_dispat ceph NOFD /proc/52900/task/54289/fd (opendir: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54290 ms_local ceph cwd unknown /proc/52900/task/54290/cwd (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54290 ms_local ceph rtd unknown /proc/52900/task/54290/root (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54290 ms_local ceph txt unknown /proc/52900/task/54290/exe (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54290 ms_local ceph NOFD /proc/52900/task/54290/fd (opendir: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54291 ms_dispat ceph cwd unknown /proc/52900/task/54291/cwd (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54291 ms_dispat ceph rtd unknown /proc/52900/task/54291/root (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54291 ms_dispat ceph txt unknown /proc/52900/task/54291/exe (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54291 ms_dispat ceph NOFD /proc/52900/task/54291/fd (opendir: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54292 ms_local ceph cwd unknown /proc/52900/task/54292/cwd (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54292 ms_local ceph rtd unknown /proc/52900/task/54292/root (readlink: Permission denied) 2024-09-21T07:08:34.758 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54292 ms_local ceph txt unknown /proc/52900/task/54292/exe (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54292 ms_local ceph NOFD /proc/52900/task/54292/fd (opendir: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54293 ms_dispat ceph cwd unknown /proc/52900/task/54293/cwd (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54293 ms_dispat ceph rtd unknown /proc/52900/task/54293/root (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54293 ms_dispat ceph txt unknown /proc/52900/task/54293/exe (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54293 ms_dispat ceph NOFD /proc/52900/task/54293/fd (opendir: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54294 ms_local ceph cwd unknown /proc/52900/task/54294/cwd (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54294 ms_local ceph rtd unknown /proc/52900/task/54294/root (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54294 ms_local ceph txt unknown /proc/52900/task/54294/exe (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54294 ms_local ceph NOFD /proc/52900/task/54294/fd (opendir: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54295 fn_anonym ceph cwd unknown /proc/52900/task/54295/cwd (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54295 fn_anonym ceph rtd unknown /proc/52900/task/54295/root (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54295 fn_anonym ceph txt unknown /proc/52900/task/54295/exe (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54295 fn_anonym ceph NOFD /proc/52900/task/54295/fd (opendir: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54296 finisher ceph cwd unknown /proc/52900/task/54296/cwd (readlink: Permission denied) 2024-09-21T07:08:34.759 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54296 finisher ceph rtd unknown /proc/52900/task/54296/root (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54296 finisher ceph txt unknown /proc/52900/task/54296/exe (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54296 finisher ceph NOFD /proc/52900/task/54296/fd (opendir: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54297 safe_time ceph cwd unknown /proc/52900/task/54297/cwd (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54297 safe_time ceph rtd unknown /proc/52900/task/54297/root (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54297 safe_time ceph txt unknown /proc/52900/task/54297/exe (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54297 safe_time ceph NOFD /proc/52900/task/54297/fd (opendir: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54298 safe_time ceph cwd unknown /proc/52900/task/54298/cwd (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54298 safe_time ceph rtd unknown /proc/52900/task/54298/root (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54298 safe_time ceph txt unknown /proc/52900/task/54298/exe (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54298 safe_time ceph NOFD /proc/52900/task/54298/fd (opendir: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54299 ceph-osd ceph cwd unknown /proc/52900/task/54299/cwd (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54299 ceph-osd ceph rtd unknown /proc/52900/task/54299/root (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54299 ceph-osd ceph txt unknown /proc/52900/task/54299/exe (readlink: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54299 ceph-osd ceph NOFD /proc/52900/task/54299/fd (opendir: Permission denied) 2024-09-21T07:08:34.760 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54300 osd_srv_a ceph cwd unknown /proc/52900/task/54300/cwd (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54300 osd_srv_a ceph rtd unknown /proc/52900/task/54300/root (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54300 osd_srv_a ceph txt unknown /proc/52900/task/54300/exe (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54300 osd_srv_a ceph NOFD /proc/52900/task/54300/fd (opendir: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54301 tp_osd_tp ceph cwd unknown /proc/52900/task/54301/cwd (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54301 tp_osd_tp ceph rtd unknown /proc/52900/task/54301/root (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54301 tp_osd_tp ceph txt unknown /proc/52900/task/54301/exe (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54301 tp_osd_tp ceph NOFD /proc/52900/task/54301/fd (opendir: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54302 tp_osd_tp ceph cwd unknown /proc/52900/task/54302/cwd (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54302 tp_osd_tp ceph rtd unknown /proc/52900/task/54302/root (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54302 tp_osd_tp ceph txt unknown /proc/52900/task/54302/exe (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54302 tp_osd_tp ceph NOFD /proc/52900/task/54302/fd (opendir: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54303 tp_osd_tp ceph cwd unknown /proc/52900/task/54303/cwd (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54303 tp_osd_tp ceph rtd unknown /proc/52900/task/54303/root (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54303 tp_osd_tp ceph txt unknown /proc/52900/task/54303/exe (readlink: Permission denied) 2024-09-21T07:08:34.761 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54303 tp_osd_tp ceph NOFD /proc/52900/task/54303/fd (opendir: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54304 tp_osd_tp ceph cwd unknown /proc/52900/task/54304/cwd (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54304 tp_osd_tp ceph rtd unknown /proc/52900/task/54304/root (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54304 tp_osd_tp ceph txt unknown /proc/52900/task/54304/exe (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54304 tp_osd_tp ceph NOFD /proc/52900/task/54304/fd (opendir: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54305 tp_osd_tp ceph cwd unknown /proc/52900/task/54305/cwd (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54305 tp_osd_tp ceph rtd unknown /proc/52900/task/54305/root (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54305 tp_osd_tp ceph txt unknown /proc/52900/task/54305/exe (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54305 tp_osd_tp ceph NOFD /proc/52900/task/54305/fd (opendir: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54306 tp_osd_tp ceph cwd unknown /proc/52900/task/54306/cwd (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54306 tp_osd_tp ceph rtd unknown /proc/52900/task/54306/root (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54306 tp_osd_tp ceph txt unknown /proc/52900/task/54306/exe (readlink: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54306 tp_osd_tp ceph NOFD /proc/52900/task/54306/fd (opendir: Permission denied) 2024-09-21T07:08:34.762 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54307 tp_osd_tp ceph cwd unknown /proc/52900/task/54307/cwd (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54307 tp_osd_tp ceph rtd unknown /proc/52900/task/54307/root (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54307 tp_osd_tp ceph txt unknown /proc/52900/task/54307/exe (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54307 tp_osd_tp ceph NOFD /proc/52900/task/54307/fd (opendir: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54308 tp_osd_tp ceph cwd unknown /proc/52900/task/54308/cwd (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54308 tp_osd_tp ceph rtd unknown /proc/52900/task/54308/root (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54308 tp_osd_tp ceph txt unknown /proc/52900/task/54308/exe (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54308 tp_osd_tp ceph NOFD /proc/52900/task/54308/fd (opendir: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54309 tp_osd_tp ceph cwd unknown /proc/52900/task/54309/cwd (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54309 tp_osd_tp ceph rtd unknown /proc/52900/task/54309/root (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54309 tp_osd_tp ceph txt unknown /proc/52900/task/54309/exe (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54309 tp_osd_tp ceph NOFD /proc/52900/task/54309/fd (opendir: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54310 tp_osd_tp ceph cwd unknown /proc/52900/task/54310/cwd (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54310 tp_osd_tp ceph rtd unknown /proc/52900/task/54310/root (readlink: Permission denied) 2024-09-21T07:08:34.763 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54310 tp_osd_tp ceph txt unknown /proc/52900/task/54310/exe (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54310 tp_osd_tp ceph NOFD /proc/52900/task/54310/fd (opendir: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54311 tp_osd_tp ceph cwd unknown /proc/52900/task/54311/cwd (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54311 tp_osd_tp ceph rtd unknown /proc/52900/task/54311/root (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54311 tp_osd_tp ceph txt unknown /proc/52900/task/54311/exe (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54311 tp_osd_tp ceph NOFD /proc/52900/task/54311/fd (opendir: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54312 tp_osd_tp ceph cwd unknown /proc/52900/task/54312/cwd (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54312 tp_osd_tp ceph rtd unknown /proc/52900/task/54312/root (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54312 tp_osd_tp ceph txt unknown /proc/52900/task/54312/exe (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54312 tp_osd_tp ceph NOFD /proc/52900/task/54312/fd (opendir: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54313 tp_osd_tp ceph cwd unknown /proc/52900/task/54313/cwd (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54313 tp_osd_tp ceph rtd unknown /proc/52900/task/54313/root (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54313 tp_osd_tp ceph txt unknown /proc/52900/task/54313/exe (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54313 tp_osd_tp ceph NOFD /proc/52900/task/54313/fd (opendir: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54314 tp_osd_tp ceph cwd unknown /proc/52900/task/54314/cwd (readlink: Permission denied) 2024-09-21T07:08:34.764 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54314 tp_osd_tp ceph rtd unknown /proc/52900/task/54314/root (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54314 tp_osd_tp ceph txt unknown /proc/52900/task/54314/exe (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54314 tp_osd_tp ceph NOFD /proc/52900/task/54314/fd (opendir: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54315 tp_osd_tp ceph cwd unknown /proc/52900/task/54315/cwd (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54315 tp_osd_tp ceph rtd unknown /proc/52900/task/54315/root (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54315 tp_osd_tp ceph txt unknown /proc/52900/task/54315/exe (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54315 tp_osd_tp ceph NOFD /proc/52900/task/54315/fd (opendir: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54316 tp_osd_tp ceph cwd unknown /proc/52900/task/54316/cwd (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54316 tp_osd_tp ceph rtd unknown /proc/52900/task/54316/root (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54316 tp_osd_tp ceph txt unknown /proc/52900/task/54316/exe (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54316 tp_osd_tp ceph NOFD /proc/52900/task/54316/fd (opendir: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54317 osd_srv_h ceph cwd unknown /proc/52900/task/54317/cwd (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54317 osd_srv_h ceph rtd unknown /proc/52900/task/54317/root (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54317 osd_srv_h ceph txt unknown /proc/52900/task/54317/exe (readlink: Permission denied) 2024-09-21T07:08:34.765 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 52900 54317 osd_srv_h ceph NOFD /proc/52900/task/54317/fd (opendir: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 53444 root cwd unknown /proc/53444/cwd (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 53444 root rtd unknown /proc/53444/root (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 53444 root txt unknown /proc/53444/exe (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 53444 root NOFD /proc/53444/fd (opendir: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 53461 root cwd unknown /proc/53461/cwd (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 53461 root rtd unknown /proc/53461/root (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 53461 root txt unknown /proc/53461/exe (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 53461 root NOFD /proc/53461/fd (opendir: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56830 root cwd unknown /proc/56830/cwd (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56830 root rtd unknown /proc/56830/root (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56830 root txt unknown /proc/56830/exe (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56830 root NOFD /proc/56830/fd (opendir: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56924 root cwd unknown /proc/56924/cwd (readlink: Permission denied) 2024-09-21T07:08:34.766 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56924 root rtd unknown /proc/56924/root (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56924 root txt unknown /proc/56924/exe (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/0 56924 root NOFD /proc/56924/fd (opendir: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:anacron 56953 root cwd unknown /proc/56953/cwd (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:anacron 56953 root rtd unknown /proc/56953/root (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:anacron 56953 root txt unknown /proc/56953/exe (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:anacron 56953 root NOFD /proc/56953/fd (opendir: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 58891 root cwd unknown /proc/58891/cwd (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 58891 root rtd unknown /proc/58891/root (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 58891 root txt unknown /proc/58891/exe (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 58891 root NOFD /proc/58891/fd (opendir: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 59476 root cwd unknown /proc/59476/cwd (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 59476 root rtd unknown /proc/59476/root (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 59476 root txt unknown /proc/59476/exe (readlink: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 59476 root NOFD /proc/59476/fd (opendir: Permission denied) 2024-09-21T07:08:34.767 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 59478 root cwd unknown /proc/59478/cwd (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 59478 root rtd unknown /proc/59478/root (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 59478 root txt unknown /proc/59478/exe (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 59478 root NOFD /proc/59478/fd (opendir: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 ceph cwd unknown /proc/59480/cwd (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 ceph rtd unknown /proc/59480/root (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 ceph txt unknown /proc/59480/exe (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 ceph NOFD /proc/59480/fd (opendir: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59481 log ceph cwd unknown /proc/59480/task/59481/cwd (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59481 log ceph rtd unknown /proc/59480/task/59481/root (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59481 log ceph txt unknown /proc/59480/task/59481/exe (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59481 log ceph NOFD /proc/59480/task/59481/fd (opendir: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59483 msgr-work ceph cwd unknown /proc/59480/task/59483/cwd (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59483 msgr-work ceph rtd unknown /proc/59480/task/59483/root (readlink: Permission denied) 2024-09-21T07:08:34.768 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59483 msgr-work ceph txt unknown /proc/59480/task/59483/exe (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59483 msgr-work ceph NOFD /proc/59480/task/59483/fd (opendir: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59484 msgr-work ceph cwd unknown /proc/59480/task/59484/cwd (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59484 msgr-work ceph rtd unknown /proc/59480/task/59484/root (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59484 msgr-work ceph txt unknown /proc/59480/task/59484/exe (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59484 msgr-work ceph NOFD /proc/59480/task/59484/fd (opendir: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59485 msgr-work ceph cwd unknown /proc/59480/task/59485/cwd (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59485 msgr-work ceph rtd unknown /proc/59480/task/59485/root (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59485 msgr-work ceph txt unknown /proc/59480/task/59485/exe (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59485 msgr-work ceph NOFD /proc/59480/task/59485/fd (opendir: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59489 service ceph cwd unknown /proc/59480/task/59489/cwd (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59489 service ceph rtd unknown /proc/59480/task/59489/root (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59489 service ceph txt unknown /proc/59480/task/59489/exe (readlink: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59489 service ceph NOFD /proc/59480/task/59489/fd (opendir: Permission denied) 2024-09-21T07:08:34.769 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59490 admin_soc ceph cwd unknown /proc/59480/task/59490/cwd (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59490 admin_soc ceph rtd unknown /proc/59480/task/59490/root (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59490 admin_soc ceph txt unknown /proc/59480/task/59490/exe (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59490 admin_soc ceph NOFD /proc/59480/task/59490/fd (opendir: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59771 signal_ha ceph cwd unknown /proc/59480/task/59771/cwd (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59771 signal_ha ceph rtd unknown /proc/59480/task/59771/root (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59771 signal_ha ceph txt unknown /proc/59480/task/59771/exe (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59771 signal_ha ceph NOFD /proc/59480/task/59771/fd (opendir: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59772 io_contex ceph cwd unknown /proc/59480/task/59772/cwd (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59772 io_contex ceph rtd unknown /proc/59480/task/59772/root (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59772 io_contex ceph txt unknown /proc/59480/task/59772/exe (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59772 io_contex ceph NOFD /proc/59480/task/59772/fd (opendir: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59773 io_contex ceph cwd unknown /proc/59480/task/59773/cwd (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59773 io_contex ceph rtd unknown /proc/59480/task/59773/root (readlink: Permission denied) 2024-09-21T07:08:34.770 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59773 io_contex ceph txt unknown /proc/59480/task/59773/exe (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59773 io_contex ceph NOFD /proc/59480/task/59773/fd (opendir: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59782 OpHistory ceph cwd unknown /proc/59480/task/59782/cwd (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59782 OpHistory ceph rtd unknown /proc/59480/task/59782/root (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59782 OpHistory ceph txt unknown /proc/59480/task/59782/exe (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59782 OpHistory ceph NOFD /proc/59480/task/59782/fd (opendir: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59783 ceph_time ceph cwd unknown /proc/59480/task/59783/cwd (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59783 ceph_time ceph rtd unknown /proc/59480/task/59783/root (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59783 ceph_time ceph txt unknown /proc/59480/task/59783/exe (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 59783 ceph_time ceph NOFD /proc/59480/task/59783/fd (opendir: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60029 ceph-osd ceph cwd unknown /proc/59480/task/60029/cwd (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60029 ceph-osd ceph rtd unknown /proc/59480/task/60029/root (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60029 ceph-osd ceph txt unknown /proc/59480/task/60029/exe (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60029 ceph-osd ceph NOFD /proc/59480/task/60029/fd (opendir: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60030 safe_time ceph cwd unknown /proc/59480/task/60030/cwd (readlink: Permission denied) 2024-09-21T07:08:34.771 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60030 safe_time ceph rtd unknown /proc/59480/task/60030/root (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60030 safe_time ceph txt unknown /proc/59480/task/60030/exe (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60030 safe_time ceph NOFD /proc/59480/task/60030/fd (opendir: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60031 safe_time ceph cwd unknown /proc/59480/task/60031/cwd (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60031 safe_time ceph rtd unknown /proc/59480/task/60031/root (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60031 safe_time ceph txt unknown /proc/59480/task/60031/exe (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60031 safe_time ceph NOFD /proc/59480/task/60031/fd (opendir: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60032 safe_time ceph cwd unknown /proc/59480/task/60032/cwd (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60032 safe_time ceph rtd unknown /proc/59480/task/60032/root (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60032 safe_time ceph txt unknown /proc/59480/task/60032/exe (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60032 safe_time ceph NOFD /proc/59480/task/60032/fd (opendir: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60033 safe_time ceph cwd unknown /proc/59480/task/60033/cwd (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60033 safe_time ceph rtd unknown /proc/59480/task/60033/root (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60033 safe_time ceph txt unknown /proc/59480/task/60033/exe (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60033 safe_time ceph NOFD /proc/59480/task/60033/fd (opendir: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60034 fn_anonym ceph cwd unknown /proc/59480/task/60034/cwd (readlink: Permission denied) 2024-09-21T07:08:34.772 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60034 fn_anonym ceph rtd unknown /proc/59480/task/60034/root (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60034 fn_anonym ceph txt unknown /proc/59480/task/60034/exe (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60034 fn_anonym ceph NOFD /proc/59480/task/60034/fd (opendir: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60083 rocksdb:l ceph cwd unknown /proc/59480/task/60083/cwd (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60083 rocksdb:l ceph rtd unknown /proc/59480/task/60083/root (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60083 rocksdb:l ceph txt unknown /proc/59480/task/60083/exe (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60083 rocksdb:l ceph NOFD /proc/59480/task/60083/fd (opendir: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60084 rocksdb:l ceph cwd unknown /proc/59480/task/60084/cwd (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60084 rocksdb:l ceph rtd unknown /proc/59480/task/60084/root (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60084 rocksdb:l ceph txt unknown /proc/59480/task/60084/exe (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60084 rocksdb:l ceph NOFD /proc/59480/task/60084/fd (opendir: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60085 rocksdb:l ceph cwd unknown /proc/59480/task/60085/cwd (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60085 rocksdb:l ceph rtd unknown /proc/59480/task/60085/root (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60085 rocksdb:l ceph txt unknown /proc/59480/task/60085/exe (readlink: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60085 rocksdb:l ceph NOFD /proc/59480/task/60085/fd (opendir: Permission denied) 2024-09-21T07:08:34.773 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60086 rocksdb:h ceph cwd unknown /proc/59480/task/60086/cwd (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60086 rocksdb:h ceph rtd unknown /proc/59480/task/60086/root (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60086 rocksdb:h ceph txt unknown /proc/59480/task/60086/exe (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60086 rocksdb:h ceph NOFD /proc/59480/task/60086/fd (opendir: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60474 bstore_ai ceph cwd unknown /proc/59480/task/60474/cwd (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60474 bstore_ai ceph rtd unknown /proc/59480/task/60474/root (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60474 bstore_ai ceph txt unknown /proc/59480/task/60474/exe (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60474 bstore_ai ceph NOFD /proc/59480/task/60474/fd (opendir: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60680 bstore_ai ceph cwd unknown /proc/59480/task/60680/cwd (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60680 bstore_ai ceph rtd unknown /proc/59480/task/60680/root (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60680 bstore_ai ceph txt unknown /proc/59480/task/60680/exe (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60680 bstore_ai ceph NOFD /proc/59480/task/60680/fd (opendir: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60864 ceph-osd ceph cwd unknown /proc/59480/task/60864/cwd (readlink: Permission denied) 2024-09-21T07:08:34.774 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60864 ceph-osd ceph rtd unknown /proc/59480/task/60864/root (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60864 ceph-osd ceph txt unknown /proc/59480/task/60864/exe (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60864 ceph-osd ceph NOFD /proc/59480/task/60864/fd (opendir: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60865 cfin ceph cwd unknown /proc/59480/task/60865/cwd (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60865 cfin ceph rtd unknown /proc/59480/task/60865/root (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60865 cfin ceph txt unknown /proc/59480/task/60865/exe (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60865 cfin ceph NOFD /proc/59480/task/60865/fd (opendir: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60866 bstore_kv ceph cwd unknown /proc/59480/task/60866/cwd (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60866 bstore_kv ceph rtd unknown /proc/59480/task/60866/root (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60866 bstore_kv ceph txt unknown /proc/59480/task/60866/exe (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60866 bstore_kv ceph NOFD /proc/59480/task/60866/fd (opendir: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60867 bstore_kv ceph cwd unknown /proc/59480/task/60867/cwd (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60867 bstore_kv ceph rtd unknown /proc/59480/task/60867/root (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60867 bstore_kv ceph txt unknown /proc/59480/task/60867/exe (readlink: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60867 bstore_kv ceph NOFD /proc/59480/task/60867/fd (opendir: Permission denied) 2024-09-21T07:08:34.775 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60868 bstore_me ceph cwd unknown /proc/59480/task/60868/cwd (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60868 bstore_me ceph rtd unknown /proc/59480/task/60868/root (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60868 bstore_me ceph txt unknown /proc/59480/task/60868/exe (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60868 bstore_me ceph NOFD /proc/59480/task/60868/fd (opendir: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60869 ms_dispat ceph cwd unknown /proc/59480/task/60869/cwd (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60869 ms_dispat ceph rtd unknown /proc/59480/task/60869/root (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60869 ms_dispat ceph txt unknown /proc/59480/task/60869/exe (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60869 ms_dispat ceph NOFD /proc/59480/task/60869/fd (opendir: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60870 ms_local ceph cwd unknown /proc/59480/task/60870/cwd (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60870 ms_local ceph rtd unknown /proc/59480/task/60870/root (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60870 ms_local ceph txt unknown /proc/59480/task/60870/exe (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60870 ms_local ceph NOFD /proc/59480/task/60870/fd (opendir: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60871 safe_time ceph cwd unknown /proc/59480/task/60871/cwd (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60871 safe_time ceph rtd unknown /proc/59480/task/60871/root (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60871 safe_time ceph txt unknown /proc/59480/task/60871/exe (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60871 safe_time ceph NOFD /proc/59480/task/60871/fd (opendir: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60872 safe_time ceph cwd unknown /proc/59480/task/60872/cwd (readlink: Permission denied) 2024-09-21T07:08:34.776 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60872 safe_time ceph rtd unknown /proc/59480/task/60872/root (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60872 safe_time ceph txt unknown /proc/59480/task/60872/exe (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60872 safe_time ceph NOFD /proc/59480/task/60872/fd (opendir: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60873 ms_dispat ceph cwd unknown /proc/59480/task/60873/cwd (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60873 ms_dispat ceph rtd unknown /proc/59480/task/60873/root (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60873 ms_dispat ceph txt unknown /proc/59480/task/60873/exe (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60873 ms_dispat ceph NOFD /proc/59480/task/60873/fd (opendir: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60874 ms_local ceph cwd unknown /proc/59480/task/60874/cwd (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60874 ms_local ceph rtd unknown /proc/59480/task/60874/root (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60874 ms_local ceph txt unknown /proc/59480/task/60874/exe (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60874 ms_local ceph NOFD /proc/59480/task/60874/fd (opendir: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60875 ms_dispat ceph cwd unknown /proc/59480/task/60875/cwd (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60875 ms_dispat ceph rtd unknown /proc/59480/task/60875/root (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60875 ms_dispat ceph txt unknown /proc/59480/task/60875/exe (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60875 ms_dispat ceph NOFD /proc/59480/task/60875/fd (opendir: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60876 ms_local ceph cwd unknown /proc/59480/task/60876/cwd (readlink: Permission denied) 2024-09-21T07:08:34.777 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60876 ms_local ceph rtd unknown /proc/59480/task/60876/root (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60876 ms_local ceph txt unknown /proc/59480/task/60876/exe (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60876 ms_local ceph NOFD /proc/59480/task/60876/fd (opendir: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60877 ms_dispat ceph cwd unknown /proc/59480/task/60877/cwd (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60877 ms_dispat ceph rtd unknown /proc/59480/task/60877/root (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60877 ms_dispat ceph txt unknown /proc/59480/task/60877/exe (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60877 ms_dispat ceph NOFD /proc/59480/task/60877/fd (opendir: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60878 ms_local ceph cwd unknown /proc/59480/task/60878/cwd (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60878 ms_local ceph rtd unknown /proc/59480/task/60878/root (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60878 ms_local ceph txt unknown /proc/59480/task/60878/exe (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60878 ms_local ceph NOFD /proc/59480/task/60878/fd (opendir: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60879 ms_dispat ceph cwd unknown /proc/59480/task/60879/cwd (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60879 ms_dispat ceph rtd unknown /proc/59480/task/60879/root (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60879 ms_dispat ceph txt unknown /proc/59480/task/60879/exe (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60879 ms_dispat ceph NOFD /proc/59480/task/60879/fd (opendir: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60880 ms_local ceph cwd unknown /proc/59480/task/60880/cwd (readlink: Permission denied) 2024-09-21T07:08:34.778 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60880 ms_local ceph rtd unknown /proc/59480/task/60880/root (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60880 ms_local ceph txt unknown /proc/59480/task/60880/exe (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60880 ms_local ceph NOFD /proc/59480/task/60880/fd (opendir: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60881 ms_dispat ceph cwd unknown /proc/59480/task/60881/cwd (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60881 ms_dispat ceph rtd unknown /proc/59480/task/60881/root (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60881 ms_dispat ceph txt unknown /proc/59480/task/60881/exe (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60881 ms_dispat ceph NOFD /proc/59480/task/60881/fd (opendir: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60882 ms_local ceph cwd unknown /proc/59480/task/60882/cwd (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60882 ms_local ceph rtd unknown /proc/59480/task/60882/root (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60882 ms_local ceph txt unknown /proc/59480/task/60882/exe (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60882 ms_local ceph NOFD /proc/59480/task/60882/fd (opendir: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60883 ms_dispat ceph cwd unknown /proc/59480/task/60883/cwd (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60883 ms_dispat ceph rtd unknown /proc/59480/task/60883/root (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60883 ms_dispat ceph txt unknown /proc/59480/task/60883/exe (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60883 ms_dispat ceph NOFD /proc/59480/task/60883/fd (opendir: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60884 ms_local ceph cwd unknown /proc/59480/task/60884/cwd (readlink: Permission denied) 2024-09-21T07:08:34.779 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60884 ms_local ceph rtd unknown /proc/59480/task/60884/root (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60884 ms_local ceph txt unknown /proc/59480/task/60884/exe (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60884 ms_local ceph NOFD /proc/59480/task/60884/fd (opendir: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60885 fn_anonym ceph cwd unknown /proc/59480/task/60885/cwd (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60885 fn_anonym ceph rtd unknown /proc/59480/task/60885/root (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60885 fn_anonym ceph txt unknown /proc/59480/task/60885/exe (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60885 fn_anonym ceph NOFD /proc/59480/task/60885/fd (opendir: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60886 finisher ceph cwd unknown /proc/59480/task/60886/cwd (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60886 finisher ceph rtd unknown /proc/59480/task/60886/root (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60886 finisher ceph txt unknown /proc/59480/task/60886/exe (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60886 finisher ceph NOFD /proc/59480/task/60886/fd (opendir: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60887 safe_time ceph cwd unknown /proc/59480/task/60887/cwd (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60887 safe_time ceph rtd unknown /proc/59480/task/60887/root (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60887 safe_time ceph txt unknown /proc/59480/task/60887/exe (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60887 safe_time ceph NOFD /proc/59480/task/60887/fd (opendir: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60888 safe_time ceph cwd unknown /proc/59480/task/60888/cwd (readlink: Permission denied) 2024-09-21T07:08:34.780 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60888 safe_time ceph rtd unknown /proc/59480/task/60888/root (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60888 safe_time ceph txt unknown /proc/59480/task/60888/exe (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60888 safe_time ceph NOFD /proc/59480/task/60888/fd (opendir: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60889 ceph-osd ceph cwd unknown /proc/59480/task/60889/cwd (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60889 ceph-osd ceph rtd unknown /proc/59480/task/60889/root (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60889 ceph-osd ceph txt unknown /proc/59480/task/60889/exe (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60889 ceph-osd ceph NOFD /proc/59480/task/60889/fd (opendir: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60890 osd_srv_a ceph cwd unknown /proc/59480/task/60890/cwd (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60890 osd_srv_a ceph rtd unknown /proc/59480/task/60890/root (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60890 osd_srv_a ceph txt unknown /proc/59480/task/60890/exe (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60890 osd_srv_a ceph NOFD /proc/59480/task/60890/fd (opendir: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60891 tp_osd_tp ceph cwd unknown /proc/59480/task/60891/cwd (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60891 tp_osd_tp ceph rtd unknown /proc/59480/task/60891/root (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60891 tp_osd_tp ceph txt unknown /proc/59480/task/60891/exe (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60891 tp_osd_tp ceph NOFD /proc/59480/task/60891/fd (opendir: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60892 tp_osd_tp ceph cwd unknown /proc/59480/task/60892/cwd (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60892 tp_osd_tp ceph rtd unknown /proc/59480/task/60892/root (readlink: Permission denied) 2024-09-21T07:08:34.781 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60892 tp_osd_tp ceph txt unknown /proc/59480/task/60892/exe (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60892 tp_osd_tp ceph NOFD /proc/59480/task/60892/fd (opendir: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60893 tp_osd_tp ceph cwd unknown /proc/59480/task/60893/cwd (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60893 tp_osd_tp ceph rtd unknown /proc/59480/task/60893/root (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60893 tp_osd_tp ceph txt unknown /proc/59480/task/60893/exe (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60893 tp_osd_tp ceph NOFD /proc/59480/task/60893/fd (opendir: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60894 tp_osd_tp ceph cwd unknown /proc/59480/task/60894/cwd (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60894 tp_osd_tp ceph rtd unknown /proc/59480/task/60894/root (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60894 tp_osd_tp ceph txt unknown /proc/59480/task/60894/exe (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60894 tp_osd_tp ceph NOFD /proc/59480/task/60894/fd (opendir: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60895 tp_osd_tp ceph cwd unknown /proc/59480/task/60895/cwd (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60895 tp_osd_tp ceph rtd unknown /proc/59480/task/60895/root (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60895 tp_osd_tp ceph txt unknown /proc/59480/task/60895/exe (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60895 tp_osd_tp ceph NOFD /proc/59480/task/60895/fd (opendir: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60896 tp_osd_tp ceph cwd unknown /proc/59480/task/60896/cwd (readlink: Permission denied) 2024-09-21T07:08:34.782 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60896 tp_osd_tp ceph rtd unknown /proc/59480/task/60896/root (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60896 tp_osd_tp ceph txt unknown /proc/59480/task/60896/exe (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60896 tp_osd_tp ceph NOFD /proc/59480/task/60896/fd (opendir: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60897 tp_osd_tp ceph cwd unknown /proc/59480/task/60897/cwd (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60897 tp_osd_tp ceph rtd unknown /proc/59480/task/60897/root (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60897 tp_osd_tp ceph txt unknown /proc/59480/task/60897/exe (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60897 tp_osd_tp ceph NOFD /proc/59480/task/60897/fd (opendir: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60898 tp_osd_tp ceph cwd unknown /proc/59480/task/60898/cwd (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60898 tp_osd_tp ceph rtd unknown /proc/59480/task/60898/root (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60898 tp_osd_tp ceph txt unknown /proc/59480/task/60898/exe (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60898 tp_osd_tp ceph NOFD /proc/59480/task/60898/fd (opendir: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60899 tp_osd_tp ceph cwd unknown /proc/59480/task/60899/cwd (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60899 tp_osd_tp ceph rtd unknown /proc/59480/task/60899/root (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60899 tp_osd_tp ceph txt unknown /proc/59480/task/60899/exe (readlink: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60899 tp_osd_tp ceph NOFD /proc/59480/task/60899/fd (opendir: Permission denied) 2024-09-21T07:08:34.783 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60900 tp_osd_tp ceph cwd unknown /proc/59480/task/60900/cwd (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60900 tp_osd_tp ceph rtd unknown /proc/59480/task/60900/root (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60900 tp_osd_tp ceph txt unknown /proc/59480/task/60900/exe (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60900 tp_osd_tp ceph NOFD /proc/59480/task/60900/fd (opendir: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60901 tp_osd_tp ceph cwd unknown /proc/59480/task/60901/cwd (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60901 tp_osd_tp ceph rtd unknown /proc/59480/task/60901/root (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60901 tp_osd_tp ceph txt unknown /proc/59480/task/60901/exe (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60901 tp_osd_tp ceph NOFD /proc/59480/task/60901/fd (opendir: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60902 tp_osd_tp ceph cwd unknown /proc/59480/task/60902/cwd (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60902 tp_osd_tp ceph rtd unknown /proc/59480/task/60902/root (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60902 tp_osd_tp ceph txt unknown /proc/59480/task/60902/exe (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60902 tp_osd_tp ceph NOFD /proc/59480/task/60902/fd (opendir: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60903 tp_osd_tp ceph cwd unknown /proc/59480/task/60903/cwd (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60903 tp_osd_tp ceph rtd unknown /proc/59480/task/60903/root (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60903 tp_osd_tp ceph txt unknown /proc/59480/task/60903/exe (readlink: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60903 tp_osd_tp ceph NOFD /proc/59480/task/60903/fd (opendir: Permission denied) 2024-09-21T07:08:34.784 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60904 tp_osd_tp ceph cwd unknown /proc/59480/task/60904/cwd (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60904 tp_osd_tp ceph rtd unknown /proc/59480/task/60904/root (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60904 tp_osd_tp ceph txt unknown /proc/59480/task/60904/exe (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60904 tp_osd_tp ceph NOFD /proc/59480/task/60904/fd (opendir: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60905 tp_osd_tp ceph cwd unknown /proc/59480/task/60905/cwd (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60905 tp_osd_tp ceph rtd unknown /proc/59480/task/60905/root (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60905 tp_osd_tp ceph txt unknown /proc/59480/task/60905/exe (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60905 tp_osd_tp ceph NOFD /proc/59480/task/60905/fd (opendir: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60906 tp_osd_tp ceph cwd unknown /proc/59480/task/60906/cwd (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60906 tp_osd_tp ceph rtd unknown /proc/59480/task/60906/root (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60906 tp_osd_tp ceph txt unknown /proc/59480/task/60906/exe (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60906 tp_osd_tp ceph NOFD /proc/59480/task/60906/fd (opendir: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60907 osd_srv_h ceph cwd unknown /proc/59480/task/60907/cwd (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60907 osd_srv_h ceph rtd unknown /proc/59480/task/60907/root (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60907 osd_srv_h ceph txt unknown /proc/59480/task/60907/exe (readlink: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 59480 60907 osd_srv_h ceph NOFD /proc/59480/task/60907/fd (opendir: Permission denied) 2024-09-21T07:08:34.785 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 60045 root cwd unknown /proc/60045/cwd (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 60045 root rtd unknown /proc/60045/root (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 60045 root txt unknown /proc/60045/exe (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 60045 root NOFD /proc/60045/fd (opendir: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 60077 root cwd unknown /proc/60077/cwd (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 60077 root rtd unknown /proc/60077/root (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 60077 root txt unknown /proc/60077/exe (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 60077 root NOFD /proc/60077/fd (opendir: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 60284 root cwd unknown /proc/60284/cwd (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 60284 root rtd unknown /proc/60284/root (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 60284 root txt unknown /proc/60284/exe (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 60284 root NOFD /proc/60284/fd (opendir: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 66118 root cwd unknown /proc/66118/cwd (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 66118 root rtd unknown /proc/66118/root (readlink: Permission denied) 2024-09-21T07:08:34.786 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 66118 root txt unknown /proc/66118/exe (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 66118 root NOFD /proc/66118/fd (opendir: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 66120 root cwd unknown /proc/66120/cwd (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 66120 root rtd unknown /proc/66120/root (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 66120 root txt unknown /proc/66120/exe (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 66120 root NOFD /proc/66120/fd (opendir: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 ceph cwd unknown /proc/66122/cwd (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 ceph rtd unknown /proc/66122/root (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 ceph txt unknown /proc/66122/exe (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 ceph NOFD /proc/66122/fd (opendir: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66123 log ceph cwd unknown /proc/66122/task/66123/cwd (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66123 log ceph rtd unknown /proc/66122/task/66123/root (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66123 log ceph txt unknown /proc/66122/task/66123/exe (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66123 log ceph NOFD /proc/66122/task/66123/fd (opendir: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66125 msgr-work ceph cwd unknown /proc/66122/task/66125/cwd (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66125 msgr-work ceph rtd unknown /proc/66122/task/66125/root (readlink: Permission denied) 2024-09-21T07:08:34.787 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66125 msgr-work ceph txt unknown /proc/66122/task/66125/exe (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66125 msgr-work ceph NOFD /proc/66122/task/66125/fd (opendir: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66126 msgr-work ceph cwd unknown /proc/66122/task/66126/cwd (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66126 msgr-work ceph rtd unknown /proc/66122/task/66126/root (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66126 msgr-work ceph txt unknown /proc/66122/task/66126/exe (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66126 msgr-work ceph NOFD /proc/66122/task/66126/fd (opendir: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66127 msgr-work ceph cwd unknown /proc/66122/task/66127/cwd (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66127 msgr-work ceph rtd unknown /proc/66122/task/66127/root (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66127 msgr-work ceph txt unknown /proc/66122/task/66127/exe (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66127 msgr-work ceph NOFD /proc/66122/task/66127/fd (opendir: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66131 service ceph cwd unknown /proc/66122/task/66131/cwd (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66131 service ceph rtd unknown /proc/66122/task/66131/root (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66131 service ceph txt unknown /proc/66122/task/66131/exe (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66131 service ceph NOFD /proc/66122/task/66131/fd (opendir: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66132 admin_soc ceph cwd unknown /proc/66122/task/66132/cwd (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66132 admin_soc ceph rtd unknown /proc/66122/task/66132/root (readlink: Permission denied) 2024-09-21T07:08:34.788 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66132 admin_soc ceph txt unknown /proc/66122/task/66132/exe (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66132 admin_soc ceph NOFD /proc/66122/task/66132/fd (opendir: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66402 signal_ha ceph cwd unknown /proc/66122/task/66402/cwd (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66402 signal_ha ceph rtd unknown /proc/66122/task/66402/root (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66402 signal_ha ceph txt unknown /proc/66122/task/66402/exe (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66402 signal_ha ceph NOFD /proc/66122/task/66402/fd (opendir: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66403 io_contex ceph cwd unknown /proc/66122/task/66403/cwd (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66403 io_contex ceph rtd unknown /proc/66122/task/66403/root (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66403 io_contex ceph txt unknown /proc/66122/task/66403/exe (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66403 io_contex ceph NOFD /proc/66122/task/66403/fd (opendir: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66404 io_contex ceph cwd unknown /proc/66122/task/66404/cwd (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66404 io_contex ceph rtd unknown /proc/66122/task/66404/root (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66404 io_contex ceph txt unknown /proc/66122/task/66404/exe (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66404 io_contex ceph NOFD /proc/66122/task/66404/fd (opendir: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66426 OpHistory ceph cwd unknown /proc/66122/task/66426/cwd (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66426 OpHistory ceph rtd unknown /proc/66122/task/66426/root (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66426 OpHistory ceph txt unknown /proc/66122/task/66426/exe (readlink: Permission denied) 2024-09-21T07:08:34.789 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66426 OpHistory ceph NOFD /proc/66122/task/66426/fd (opendir: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66427 ceph_time ceph cwd unknown /proc/66122/task/66427/cwd (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66427 ceph_time ceph rtd unknown /proc/66122/task/66427/root (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66427 ceph_time ceph txt unknown /proc/66122/task/66427/exe (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66427 ceph_time ceph NOFD /proc/66122/task/66427/fd (opendir: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66685 ceph-osd ceph cwd unknown /proc/66122/task/66685/cwd (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66685 ceph-osd ceph rtd unknown /proc/66122/task/66685/root (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66685 ceph-osd ceph txt unknown /proc/66122/task/66685/exe (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66685 ceph-osd ceph NOFD /proc/66122/task/66685/fd (opendir: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66686 safe_time ceph cwd unknown /proc/66122/task/66686/cwd (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66686 safe_time ceph rtd unknown /proc/66122/task/66686/root (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66686 safe_time ceph txt unknown /proc/66122/task/66686/exe (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66686 safe_time ceph NOFD /proc/66122/task/66686/fd (opendir: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66687 safe_time ceph cwd unknown /proc/66122/task/66687/cwd (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66687 safe_time ceph rtd unknown /proc/66122/task/66687/root (readlink: Permission denied) 2024-09-21T07:08:34.790 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66687 safe_time ceph txt unknown /proc/66122/task/66687/exe (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66687 safe_time ceph NOFD /proc/66122/task/66687/fd (opendir: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66688 safe_time ceph cwd unknown /proc/66122/task/66688/cwd (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66688 safe_time ceph rtd unknown /proc/66122/task/66688/root (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66688 safe_time ceph txt unknown /proc/66122/task/66688/exe (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66688 safe_time ceph NOFD /proc/66122/task/66688/fd (opendir: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66689 safe_time ceph cwd unknown /proc/66122/task/66689/cwd (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66689 safe_time ceph rtd unknown /proc/66122/task/66689/root (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66689 safe_time ceph txt unknown /proc/66122/task/66689/exe (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66689 safe_time ceph NOFD /proc/66122/task/66689/fd (opendir: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66690 fn_anonym ceph cwd unknown /proc/66122/task/66690/cwd (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66690 fn_anonym ceph rtd unknown /proc/66122/task/66690/root (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66690 fn_anonym ceph txt unknown /proc/66122/task/66690/exe (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66690 fn_anonym ceph NOFD /proc/66122/task/66690/fd (opendir: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66734 rocksdb:l ceph cwd unknown /proc/66122/task/66734/cwd (readlink: Permission denied) 2024-09-21T07:08:34.791 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66734 rocksdb:l ceph rtd unknown /proc/66122/task/66734/root (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66734 rocksdb:l ceph txt unknown /proc/66122/task/66734/exe (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66734 rocksdb:l ceph NOFD /proc/66122/task/66734/fd (opendir: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66735 rocksdb:l ceph cwd unknown /proc/66122/task/66735/cwd (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66735 rocksdb:l ceph rtd unknown /proc/66122/task/66735/root (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66735 rocksdb:l ceph txt unknown /proc/66122/task/66735/exe (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66735 rocksdb:l ceph NOFD /proc/66122/task/66735/fd (opendir: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66736 rocksdb:l ceph cwd unknown /proc/66122/task/66736/cwd (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66736 rocksdb:l ceph rtd unknown /proc/66122/task/66736/root (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66736 rocksdb:l ceph txt unknown /proc/66122/task/66736/exe (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66736 rocksdb:l ceph NOFD /proc/66122/task/66736/fd (opendir: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66737 rocksdb:h ceph cwd unknown /proc/66122/task/66737/cwd (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66737 rocksdb:h ceph rtd unknown /proc/66122/task/66737/root (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66737 rocksdb:h ceph txt unknown /proc/66122/task/66737/exe (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 66737 rocksdb:h ceph NOFD /proc/66122/task/66737/fd (opendir: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67136 bstore_ai ceph cwd unknown /proc/66122/task/67136/cwd (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67136 bstore_ai ceph rtd unknown /proc/66122/task/67136/root (readlink: Permission denied) 2024-09-21T07:08:34.792 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67136 bstore_ai ceph txt unknown /proc/66122/task/67136/exe (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67136 bstore_ai ceph NOFD /proc/66122/task/67136/fd (opendir: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67344 bstore_ai ceph cwd unknown /proc/66122/task/67344/cwd (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67344 bstore_ai ceph rtd unknown /proc/66122/task/67344/root (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67344 bstore_ai ceph txt unknown /proc/66122/task/67344/exe (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67344 bstore_ai ceph NOFD /proc/66122/task/67344/fd (opendir: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67530 ceph-osd ceph cwd unknown /proc/66122/task/67530/cwd (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67530 ceph-osd ceph rtd unknown /proc/66122/task/67530/root (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67530 ceph-osd ceph txt unknown /proc/66122/task/67530/exe (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67530 ceph-osd ceph NOFD /proc/66122/task/67530/fd (opendir: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67531 cfin ceph cwd unknown /proc/66122/task/67531/cwd (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67531 cfin ceph rtd unknown /proc/66122/task/67531/root (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67531 cfin ceph txt unknown /proc/66122/task/67531/exe (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67531 cfin ceph NOFD /proc/66122/task/67531/fd (opendir: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67532 bstore_kv ceph cwd unknown /proc/66122/task/67532/cwd (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67532 bstore_kv ceph rtd unknown /proc/66122/task/67532/root (readlink: Permission denied) 2024-09-21T07:08:34.793 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67532 bstore_kv ceph txt unknown /proc/66122/task/67532/exe (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67532 bstore_kv ceph NOFD /proc/66122/task/67532/fd (opendir: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67533 bstore_kv ceph cwd unknown /proc/66122/task/67533/cwd (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67533 bstore_kv ceph rtd unknown /proc/66122/task/67533/root (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67533 bstore_kv ceph txt unknown /proc/66122/task/67533/exe (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67533 bstore_kv ceph NOFD /proc/66122/task/67533/fd (opendir: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67534 bstore_me ceph cwd unknown /proc/66122/task/67534/cwd (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67534 bstore_me ceph rtd unknown /proc/66122/task/67534/root (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67534 bstore_me ceph txt unknown /proc/66122/task/67534/exe (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67534 bstore_me ceph NOFD /proc/66122/task/67534/fd (opendir: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67537 ms_dispat ceph cwd unknown /proc/66122/task/67537/cwd (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67537 ms_dispat ceph rtd unknown /proc/66122/task/67537/root (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67537 ms_dispat ceph txt unknown /proc/66122/task/67537/exe (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67537 ms_dispat ceph NOFD /proc/66122/task/67537/fd (opendir: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67538 ms_local ceph cwd unknown /proc/66122/task/67538/cwd (readlink: Permission denied) 2024-09-21T07:08:34.794 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67538 ms_local ceph rtd unknown /proc/66122/task/67538/root (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67538 ms_local ceph txt unknown /proc/66122/task/67538/exe (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67538 ms_local ceph NOFD /proc/66122/task/67538/fd (opendir: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67539 safe_time ceph cwd unknown /proc/66122/task/67539/cwd (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67539 safe_time ceph rtd unknown /proc/66122/task/67539/root (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67539 safe_time ceph txt unknown /proc/66122/task/67539/exe (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67539 safe_time ceph NOFD /proc/66122/task/67539/fd (opendir: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67540 safe_time ceph cwd unknown /proc/66122/task/67540/cwd (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67540 safe_time ceph rtd unknown /proc/66122/task/67540/root (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67540 safe_time ceph txt unknown /proc/66122/task/67540/exe (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67540 safe_time ceph NOFD /proc/66122/task/67540/fd (opendir: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67541 ms_dispat ceph cwd unknown /proc/66122/task/67541/cwd (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67541 ms_dispat ceph rtd unknown /proc/66122/task/67541/root (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67541 ms_dispat ceph txt unknown /proc/66122/task/67541/exe (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67541 ms_dispat ceph NOFD /proc/66122/task/67541/fd (opendir: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67542 ms_local ceph cwd unknown /proc/66122/task/67542/cwd (readlink: Permission denied) 2024-09-21T07:08:34.795 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67542 ms_local ceph rtd unknown /proc/66122/task/67542/root (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67542 ms_local ceph txt unknown /proc/66122/task/67542/exe (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67542 ms_local ceph NOFD /proc/66122/task/67542/fd (opendir: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67543 ms_dispat ceph cwd unknown /proc/66122/task/67543/cwd (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67543 ms_dispat ceph rtd unknown /proc/66122/task/67543/root (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67543 ms_dispat ceph txt unknown /proc/66122/task/67543/exe (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67543 ms_dispat ceph NOFD /proc/66122/task/67543/fd (opendir: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67544 ms_local ceph cwd unknown /proc/66122/task/67544/cwd (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67544 ms_local ceph rtd unknown /proc/66122/task/67544/root (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67544 ms_local ceph txt unknown /proc/66122/task/67544/exe (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67544 ms_local ceph NOFD /proc/66122/task/67544/fd (opendir: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67545 ms_dispat ceph cwd unknown /proc/66122/task/67545/cwd (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67545 ms_dispat ceph rtd unknown /proc/66122/task/67545/root (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67545 ms_dispat ceph txt unknown /proc/66122/task/67545/exe (readlink: Permission denied) 2024-09-21T07:08:34.796 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67545 ms_dispat ceph NOFD /proc/66122/task/67545/fd (opendir: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67546 ms_local ceph cwd unknown /proc/66122/task/67546/cwd (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67546 ms_local ceph rtd unknown /proc/66122/task/67546/root (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67546 ms_local ceph txt unknown /proc/66122/task/67546/exe (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67546 ms_local ceph NOFD /proc/66122/task/67546/fd (opendir: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67547 ms_dispat ceph cwd unknown /proc/66122/task/67547/cwd (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67547 ms_dispat ceph rtd unknown /proc/66122/task/67547/root (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67547 ms_dispat ceph txt unknown /proc/66122/task/67547/exe (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67547 ms_dispat ceph NOFD /proc/66122/task/67547/fd (opendir: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67548 ms_local ceph cwd unknown /proc/66122/task/67548/cwd (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67548 ms_local ceph rtd unknown /proc/66122/task/67548/root (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67548 ms_local ceph txt unknown /proc/66122/task/67548/exe (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67548 ms_local ceph NOFD /proc/66122/task/67548/fd (opendir: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67549 ms_dispat ceph cwd unknown /proc/66122/task/67549/cwd (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67549 ms_dispat ceph rtd unknown /proc/66122/task/67549/root (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67549 ms_dispat ceph txt unknown /proc/66122/task/67549/exe (readlink: Permission denied) 2024-09-21T07:08:34.797 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67549 ms_dispat ceph NOFD /proc/66122/task/67549/fd (opendir: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67550 ms_local ceph cwd unknown /proc/66122/task/67550/cwd (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67550 ms_local ceph rtd unknown /proc/66122/task/67550/root (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67550 ms_local ceph txt unknown /proc/66122/task/67550/exe (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67550 ms_local ceph NOFD /proc/66122/task/67550/fd (opendir: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67551 ms_dispat ceph cwd unknown /proc/66122/task/67551/cwd (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67551 ms_dispat ceph rtd unknown /proc/66122/task/67551/root (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67551 ms_dispat ceph txt unknown /proc/66122/task/67551/exe (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67551 ms_dispat ceph NOFD /proc/66122/task/67551/fd (opendir: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67552 ms_local ceph cwd unknown /proc/66122/task/67552/cwd (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67552 ms_local ceph rtd unknown /proc/66122/task/67552/root (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67552 ms_local ceph txt unknown /proc/66122/task/67552/exe (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67552 ms_local ceph NOFD /proc/66122/task/67552/fd (opendir: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67553 fn_anonym ceph cwd unknown /proc/66122/task/67553/cwd (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67553 fn_anonym ceph rtd unknown /proc/66122/task/67553/root (readlink: Permission denied) 2024-09-21T07:08:34.798 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67553 fn_anonym ceph txt unknown /proc/66122/task/67553/exe (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67553 fn_anonym ceph NOFD /proc/66122/task/67553/fd (opendir: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67554 finisher ceph cwd unknown /proc/66122/task/67554/cwd (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67554 finisher ceph rtd unknown /proc/66122/task/67554/root (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67554 finisher ceph txt unknown /proc/66122/task/67554/exe (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67554 finisher ceph NOFD /proc/66122/task/67554/fd (opendir: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67555 safe_time ceph cwd unknown /proc/66122/task/67555/cwd (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67555 safe_time ceph rtd unknown /proc/66122/task/67555/root (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67555 safe_time ceph txt unknown /proc/66122/task/67555/exe (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67555 safe_time ceph NOFD /proc/66122/task/67555/fd (opendir: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67556 safe_time ceph cwd unknown /proc/66122/task/67556/cwd (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67556 safe_time ceph rtd unknown /proc/66122/task/67556/root (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67556 safe_time ceph txt unknown /proc/66122/task/67556/exe (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67556 safe_time ceph NOFD /proc/66122/task/67556/fd (opendir: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67557 ceph-osd ceph cwd unknown /proc/66122/task/67557/cwd (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67557 ceph-osd ceph rtd unknown /proc/66122/task/67557/root (readlink: Permission denied) 2024-09-21T07:08:34.799 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67557 ceph-osd ceph txt unknown /proc/66122/task/67557/exe (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67557 ceph-osd ceph NOFD /proc/66122/task/67557/fd (opendir: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67558 osd_srv_a ceph cwd unknown /proc/66122/task/67558/cwd (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67558 osd_srv_a ceph rtd unknown /proc/66122/task/67558/root (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67558 osd_srv_a ceph txt unknown /proc/66122/task/67558/exe (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67558 osd_srv_a ceph NOFD /proc/66122/task/67558/fd (opendir: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67559 tp_osd_tp ceph cwd unknown /proc/66122/task/67559/cwd (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67559 tp_osd_tp ceph rtd unknown /proc/66122/task/67559/root (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67559 tp_osd_tp ceph txt unknown /proc/66122/task/67559/exe (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67559 tp_osd_tp ceph NOFD /proc/66122/task/67559/fd (opendir: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67560 tp_osd_tp ceph cwd unknown /proc/66122/task/67560/cwd (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67560 tp_osd_tp ceph rtd unknown /proc/66122/task/67560/root (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67560 tp_osd_tp ceph txt unknown /proc/66122/task/67560/exe (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67560 tp_osd_tp ceph NOFD /proc/66122/task/67560/fd (opendir: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67561 tp_osd_tp ceph cwd unknown /proc/66122/task/67561/cwd (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67561 tp_osd_tp ceph rtd unknown /proc/66122/task/67561/root (readlink: Permission denied) 2024-09-21T07:08:34.800 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67561 tp_osd_tp ceph txt unknown /proc/66122/task/67561/exe (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67561 tp_osd_tp ceph NOFD /proc/66122/task/67561/fd (opendir: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67562 tp_osd_tp ceph cwd unknown /proc/66122/task/67562/cwd (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67562 tp_osd_tp ceph rtd unknown /proc/66122/task/67562/root (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67562 tp_osd_tp ceph txt unknown /proc/66122/task/67562/exe (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67562 tp_osd_tp ceph NOFD /proc/66122/task/67562/fd (opendir: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67563 tp_osd_tp ceph cwd unknown /proc/66122/task/67563/cwd (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67563 tp_osd_tp ceph rtd unknown /proc/66122/task/67563/root (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67563 tp_osd_tp ceph txt unknown /proc/66122/task/67563/exe (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67563 tp_osd_tp ceph NOFD /proc/66122/task/67563/fd (opendir: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67564 tp_osd_tp ceph cwd unknown /proc/66122/task/67564/cwd (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67564 tp_osd_tp ceph rtd unknown /proc/66122/task/67564/root (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67564 tp_osd_tp ceph txt unknown /proc/66122/task/67564/exe (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67564 tp_osd_tp ceph NOFD /proc/66122/task/67564/fd (opendir: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67565 tp_osd_tp ceph cwd unknown /proc/66122/task/67565/cwd (readlink: Permission denied) 2024-09-21T07:08:34.801 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67565 tp_osd_tp ceph rtd unknown /proc/66122/task/67565/root (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67565 tp_osd_tp ceph txt unknown /proc/66122/task/67565/exe (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67565 tp_osd_tp ceph NOFD /proc/66122/task/67565/fd (opendir: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67566 tp_osd_tp ceph cwd unknown /proc/66122/task/67566/cwd (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67566 tp_osd_tp ceph rtd unknown /proc/66122/task/67566/root (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67566 tp_osd_tp ceph txt unknown /proc/66122/task/67566/exe (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67566 tp_osd_tp ceph NOFD /proc/66122/task/67566/fd (opendir: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67567 tp_osd_tp ceph cwd unknown /proc/66122/task/67567/cwd (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67567 tp_osd_tp ceph rtd unknown /proc/66122/task/67567/root (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67567 tp_osd_tp ceph txt unknown /proc/66122/task/67567/exe (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67567 tp_osd_tp ceph NOFD /proc/66122/task/67567/fd (opendir: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67568 tp_osd_tp ceph cwd unknown /proc/66122/task/67568/cwd (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67568 tp_osd_tp ceph rtd unknown /proc/66122/task/67568/root (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67568 tp_osd_tp ceph txt unknown /proc/66122/task/67568/exe (readlink: Permission denied) 2024-09-21T07:08:34.802 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67568 tp_osd_tp ceph NOFD /proc/66122/task/67568/fd (opendir: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67569 tp_osd_tp ceph cwd unknown /proc/66122/task/67569/cwd (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67569 tp_osd_tp ceph rtd unknown /proc/66122/task/67569/root (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67569 tp_osd_tp ceph txt unknown /proc/66122/task/67569/exe (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67569 tp_osd_tp ceph NOFD /proc/66122/task/67569/fd (opendir: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67570 tp_osd_tp ceph cwd unknown /proc/66122/task/67570/cwd (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67570 tp_osd_tp ceph rtd unknown /proc/66122/task/67570/root (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67570 tp_osd_tp ceph txt unknown /proc/66122/task/67570/exe (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67570 tp_osd_tp ceph NOFD /proc/66122/task/67570/fd (opendir: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67571 tp_osd_tp ceph cwd unknown /proc/66122/task/67571/cwd (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67571 tp_osd_tp ceph rtd unknown /proc/66122/task/67571/root (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67571 tp_osd_tp ceph txt unknown /proc/66122/task/67571/exe (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67571 tp_osd_tp ceph NOFD /proc/66122/task/67571/fd (opendir: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67572 tp_osd_tp ceph cwd unknown /proc/66122/task/67572/cwd (readlink: Permission denied) 2024-09-21T07:08:34.803 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67572 tp_osd_tp ceph rtd unknown /proc/66122/task/67572/root (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67572 tp_osd_tp ceph txt unknown /proc/66122/task/67572/exe (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67572 tp_osd_tp ceph NOFD /proc/66122/task/67572/fd (opendir: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67573 tp_osd_tp ceph cwd unknown /proc/66122/task/67573/cwd (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67573 tp_osd_tp ceph rtd unknown /proc/66122/task/67573/root (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67573 tp_osd_tp ceph txt unknown /proc/66122/task/67573/exe (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67573 tp_osd_tp ceph NOFD /proc/66122/task/67573/fd (opendir: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67574 tp_osd_tp ceph cwd unknown /proc/66122/task/67574/cwd (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67574 tp_osd_tp ceph rtd unknown /proc/66122/task/67574/root (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67574 tp_osd_tp ceph txt unknown /proc/66122/task/67574/exe (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67574 tp_osd_tp ceph NOFD /proc/66122/task/67574/fd (opendir: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67575 osd_srv_h ceph cwd unknown /proc/66122/task/67575/cwd (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67575 osd_srv_h ceph rtd unknown /proc/66122/task/67575/root (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67575 osd_srv_h ceph txt unknown /proc/66122/task/67575/exe (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-osd 66122 67575 osd_srv_h ceph NOFD /proc/66122/task/67575/fd (opendir: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 66531 root cwd unknown /proc/66531/cwd (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 66531 root rtd unknown /proc/66531/root (readlink: Permission denied) 2024-09-21T07:08:34.804 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 66531 root txt unknown /proc/66531/exe (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 66531 root NOFD /proc/66531/fd (opendir: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 66548 root cwd unknown /proc/66548/cwd (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 66548 root rtd unknown /proc/66548/root (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 66548 root txt unknown /proc/66548/exe (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 66548 root NOFD /proc/66548/fd (opendir: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 69786 root cwd unknown /proc/69786/cwd (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 69786 root rtd unknown /proc/69786/root (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 69786 root txt unknown /proc/69786/exe (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/6 69786 root NOFD /proc/69786/fd (opendir: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70429 root cwd unknown /proc/70429/cwd (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70429 root rtd unknown /proc/70429/root (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70429 root txt unknown /proc/70429/exe (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70429 root NOFD /proc/70429/fd (opendir: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70430 root cwd unknown /proc/70430/cwd (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70430 root rtd unknown /proc/70430/root (readlink: Permission denied) 2024-09-21T07:08:34.805 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70430 root txt unknown /proc/70430/exe (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/1 70430 root NOFD /proc/70430/fd (opendir: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70431 root cwd unknown /proc/70431/cwd (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70431 root rtd unknown /proc/70431/root (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70431 root txt unknown /proc/70431/exe (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70431 root NOFD /proc/70431/fd (opendir: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70448 root cwd unknown /proc/70448/cwd (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70448 root rtd unknown /proc/70448/root (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70448 root txt unknown /proc/70448/exe (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70448 root NOFD /proc/70448/fd (opendir: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70449 root cwd unknown /proc/70449/cwd (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70449 root rtd unknown /proc/70449/root (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70449 root txt unknown /proc/70449/exe (readlink: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70449 root NOFD /proc/70449/fd (opendir: Permission denied) 2024-09-21T07:08:34.806 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70466 root cwd unknown /proc/70466/cwd (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70466 root rtd unknown /proc/70466/root (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70466 root txt unknown /proc/70466/exe (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70466 root NOFD /proc/70466/fd (opendir: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70467 root cwd unknown /proc/70467/cwd (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70467 root rtd unknown /proc/70467/root (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70467 root txt unknown /proc/70467/exe (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70467 root NOFD /proc/70467/fd (opendir: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70484 root cwd unknown /proc/70484/cwd (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70484 root rtd unknown /proc/70484/root (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70484 root txt unknown /proc/70484/exe (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70484 root NOFD /proc/70484/fd (opendir: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70485 root cwd unknown /proc/70485/cwd (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70485 root rtd unknown /proc/70485/root (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70485 root txt unknown /proc/70485/exe (readlink: Permission denied) 2024-09-21T07:08:34.807 INFO:tasks.workunit.client.0.smithi028.stdout:sudo 70485 root NOFD /proc/70485/fd (opendir: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70502 root cwd unknown /proc/70502/cwd (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70502 root rtd unknown /proc/70502/root (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70502 root txt unknown /proc/70502/exe (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:journalct 70502 root NOFD /proc/70502/fd (opendir: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 70990 root cwd unknown /proc/70990/cwd (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 70990 root rtd unknown /proc/70990/root (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 70990 root txt unknown /proc/70990/exe (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 70990 root NOFD /proc/70990/fd (opendir: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 70992 root cwd unknown /proc/70992/cwd (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 70992 root rtd unknown /proc/70992/root (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 70992 root txt unknown /proc/70992/exe (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 70992 root NOFD /proc/70992/fd (opendir: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 ceph cwd unknown /proc/71001/cwd (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 ceph rtd unknown /proc/71001/root (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 ceph txt unknown /proc/71001/exe (readlink: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 ceph NOFD /proc/71001/fd (opendir: Permission denied) 2024-09-21T07:08:34.808 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71007 log ceph cwd unknown /proc/71001/task/71007/cwd (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71007 log ceph rtd unknown /proc/71001/task/71007/root (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71007 log ceph txt unknown /proc/71001/task/71007/exe (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71007 log ceph NOFD /proc/71001/task/71007/fd (opendir: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71009 msgr-work ceph cwd unknown /proc/71001/task/71009/cwd (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71009 msgr-work ceph rtd unknown /proc/71001/task/71009/root (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71009 msgr-work ceph txt unknown /proc/71001/task/71009/exe (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71009 msgr-work ceph NOFD /proc/71001/task/71009/fd (opendir: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71010 msgr-work ceph cwd unknown /proc/71001/task/71010/cwd (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71010 msgr-work ceph rtd unknown /proc/71001/task/71010/root (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71010 msgr-work ceph txt unknown /proc/71001/task/71010/exe (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71010 msgr-work ceph NOFD /proc/71001/task/71010/fd (opendir: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71011 msgr-work ceph cwd unknown /proc/71001/task/71011/cwd (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71011 msgr-work ceph rtd unknown /proc/71001/task/71011/root (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71011 msgr-work ceph txt unknown /proc/71001/task/71011/exe (readlink: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71011 msgr-work ceph NOFD /proc/71001/task/71011/fd (opendir: Permission denied) 2024-09-21T07:08:34.809 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71015 service ceph cwd unknown /proc/71001/task/71015/cwd (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71015 service ceph rtd unknown /proc/71001/task/71015/root (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71015 service ceph txt unknown /proc/71001/task/71015/exe (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71015 service ceph NOFD /proc/71001/task/71015/fd (opendir: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71016 admin_soc ceph cwd unknown /proc/71001/task/71016/cwd (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71016 admin_soc ceph rtd unknown /proc/71001/task/71016/root (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71016 admin_soc ceph txt unknown /proc/71001/task/71016/exe (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71016 admin_soc ceph NOFD /proc/71001/task/71016/fd (opendir: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71017 signal_ha ceph cwd unknown /proc/71001/task/71017/cwd (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71017 signal_ha ceph rtd unknown /proc/71001/task/71017/root (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71017 signal_ha ceph txt unknown /proc/71001/task/71017/exe (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71017 signal_ha ceph NOFD /proc/71001/task/71017/fd (opendir: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71018 io_contex ceph cwd unknown /proc/71001/task/71018/cwd (readlink: Permission denied) 2024-09-21T07:08:34.810 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71018 io_contex ceph rtd unknown /proc/71001/task/71018/root (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71018 io_contex ceph txt unknown /proc/71001/task/71018/exe (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71018 io_contex ceph NOFD /proc/71001/task/71018/fd (opendir: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71019 io_contex ceph cwd unknown /proc/71001/task/71019/cwd (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71019 io_contex ceph rtd unknown /proc/71001/task/71019/root (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71019 io_contex ceph txt unknown /proc/71001/task/71019/exe (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71019 io_contex ceph NOFD /proc/71001/task/71019/fd (opendir: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71020 ms_dispat ceph cwd unknown /proc/71001/task/71020/cwd (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71020 ms_dispat ceph rtd unknown /proc/71001/task/71020/root (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71020 ms_dispat ceph txt unknown /proc/71001/task/71020/exe (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71020 ms_dispat ceph NOFD /proc/71001/task/71020/fd (opendir: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71021 ms_local ceph cwd unknown /proc/71001/task/71021/cwd (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71021 ms_local ceph rtd unknown /proc/71001/task/71021/root (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71021 ms_local ceph txt unknown /proc/71001/task/71021/exe (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71021 ms_local ceph NOFD /proc/71001/task/71021/fd (opendir: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71022 safe_time ceph cwd unknown /proc/71001/task/71022/cwd (readlink: Permission denied) 2024-09-21T07:08:34.811 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71022 safe_time ceph rtd unknown /proc/71001/task/71022/root (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71022 safe_time ceph txt unknown /proc/71001/task/71022/exe (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71022 safe_time ceph NOFD /proc/71001/task/71022/fd (opendir: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71023 safe_time ceph cwd unknown /proc/71001/task/71023/cwd (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71023 safe_time ceph rtd unknown /proc/71001/task/71023/root (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71023 safe_time ceph txt unknown /proc/71001/task/71023/exe (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71023 safe_time ceph NOFD /proc/71001/task/71023/fd (opendir: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71024 ceph-mds ceph cwd unknown /proc/71001/task/71024/cwd (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71024 ceph-mds ceph rtd unknown /proc/71001/task/71024/root (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71024 ceph-mds ceph txt unknown /proc/71001/task/71024/exe (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71024 ceph-mds ceph NOFD /proc/71001/task/71024/fd (opendir: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71105 safe_time ceph cwd unknown /proc/71001/task/71105/cwd (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71105 safe_time ceph rtd unknown /proc/71001/task/71105/root (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71105 safe_time ceph txt unknown /proc/71001/task/71105/exe (readlink: Permission denied) 2024-09-21T07:08:34.812 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71001 71105 safe_time ceph NOFD /proc/71001/task/71105/fd (opendir: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 71362 root cwd unknown /proc/71362/cwd (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 71362 root rtd unknown /proc/71362/root (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 71362 root txt unknown /proc/71362/exe (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 71362 root NOFD /proc/71362/fd (opendir: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 71364 root cwd unknown /proc/71364/cwd (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 71364 root rtd unknown /proc/71364/root (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 71364 root txt unknown /proc/71364/exe (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 71364 root NOFD /proc/71364/fd (opendir: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 ceph cwd unknown /proc/71366/cwd (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 ceph rtd unknown /proc/71366/root (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 ceph txt unknown /proc/71366/exe (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 ceph NOFD /proc/71366/fd (opendir: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71367 log ceph cwd unknown /proc/71366/task/71367/cwd (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71367 log ceph rtd unknown /proc/71366/task/71367/root (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71367 log ceph txt unknown /proc/71366/task/71367/exe (readlink: Permission denied) 2024-09-21T07:08:34.813 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71367 log ceph NOFD /proc/71366/task/71367/fd (opendir: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71369 msgr-work ceph cwd unknown /proc/71366/task/71369/cwd (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71369 msgr-work ceph rtd unknown /proc/71366/task/71369/root (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71369 msgr-work ceph txt unknown /proc/71366/task/71369/exe (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71369 msgr-work ceph NOFD /proc/71366/task/71369/fd (opendir: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71370 msgr-work ceph cwd unknown /proc/71366/task/71370/cwd (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71370 msgr-work ceph rtd unknown /proc/71366/task/71370/root (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71370 msgr-work ceph txt unknown /proc/71366/task/71370/exe (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71370 msgr-work ceph NOFD /proc/71366/task/71370/fd (opendir: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71371 msgr-work ceph cwd unknown /proc/71366/task/71371/cwd (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71371 msgr-work ceph rtd unknown /proc/71366/task/71371/root (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71371 msgr-work ceph txt unknown /proc/71366/task/71371/exe (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71371 msgr-work ceph NOFD /proc/71366/task/71371/fd (opendir: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71375 service ceph cwd unknown /proc/71366/task/71375/cwd (readlink: Permission denied) 2024-09-21T07:08:34.814 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71375 service ceph rtd unknown /proc/71366/task/71375/root (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71375 service ceph txt unknown /proc/71366/task/71375/exe (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71375 service ceph NOFD /proc/71366/task/71375/fd (opendir: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71376 admin_soc ceph cwd unknown /proc/71366/task/71376/cwd (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71376 admin_soc ceph rtd unknown /proc/71366/task/71376/root (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71376 admin_soc ceph txt unknown /proc/71366/task/71376/exe (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71376 admin_soc ceph NOFD /proc/71366/task/71376/fd (opendir: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71377 signal_ha ceph cwd unknown /proc/71366/task/71377/cwd (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71377 signal_ha ceph rtd unknown /proc/71366/task/71377/root (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71377 signal_ha ceph txt unknown /proc/71366/task/71377/exe (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71377 signal_ha ceph NOFD /proc/71366/task/71377/fd (opendir: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71378 io_contex ceph cwd unknown /proc/71366/task/71378/cwd (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71378 io_contex ceph rtd unknown /proc/71366/task/71378/root (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71378 io_contex ceph txt unknown /proc/71366/task/71378/exe (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71378 io_contex ceph NOFD /proc/71366/task/71378/fd (opendir: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71379 io_contex ceph cwd unknown /proc/71366/task/71379/cwd (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71379 io_contex ceph rtd unknown /proc/71366/task/71379/root (readlink: Permission denied) 2024-09-21T07:08:34.815 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71379 io_contex ceph txt unknown /proc/71366/task/71379/exe (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71379 io_contex ceph NOFD /proc/71366/task/71379/fd (opendir: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71380 ms_dispat ceph cwd unknown /proc/71366/task/71380/cwd (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71380 ms_dispat ceph rtd unknown /proc/71366/task/71380/root (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71380 ms_dispat ceph txt unknown /proc/71366/task/71380/exe (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71380 ms_dispat ceph NOFD /proc/71366/task/71380/fd (opendir: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71381 ms_local ceph cwd unknown /proc/71366/task/71381/cwd (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71381 ms_local ceph rtd unknown /proc/71366/task/71381/root (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71381 ms_local ceph txt unknown /proc/71366/task/71381/exe (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71381 ms_local ceph NOFD /proc/71366/task/71381/fd (opendir: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71382 safe_time ceph cwd unknown /proc/71366/task/71382/cwd (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71382 safe_time ceph rtd unknown /proc/71366/task/71382/root (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71382 safe_time ceph txt unknown /proc/71366/task/71382/exe (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71382 safe_time ceph NOFD /proc/71366/task/71382/fd (opendir: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71383 safe_time ceph cwd unknown /proc/71366/task/71383/cwd (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71383 safe_time ceph rtd unknown /proc/71366/task/71383/root (readlink: Permission denied) 2024-09-21T07:08:34.816 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71383 safe_time ceph txt unknown /proc/71366/task/71383/exe (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71383 safe_time ceph NOFD /proc/71366/task/71383/fd (opendir: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71384 ceph-mds ceph cwd unknown /proc/71366/task/71384/cwd (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71384 ceph-mds ceph rtd unknown /proc/71366/task/71384/root (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71384 ceph-mds ceph txt unknown /proc/71366/task/71384/exe (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71384 ceph-mds ceph NOFD /proc/71366/task/71384/fd (opendir: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71432 safe_time ceph cwd unknown /proc/71366/task/71432/cwd (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71432 safe_time ceph rtd unknown /proc/71366/task/71432/root (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71432 safe_time ceph txt unknown /proc/71366/task/71432/exe (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 71366 71432 safe_time ceph NOFD /proc/71366/task/71432/fd (opendir: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72121 root cwd unknown /proc/72121/cwd (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72121 root rtd unknown /proc/72121/root (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72121 root txt unknown /proc/72121/exe (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72121 root NOFD /proc/72121/fd (opendir: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72123 root cwd unknown /proc/72123/cwd (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72123 root rtd unknown /proc/72123/root (readlink: Permission denied) 2024-09-21T07:08:34.817 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72123 root txt unknown /proc/72123/exe (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72123 root NOFD /proc/72123/fd (opendir: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 ceph cwd unknown /proc/72137/cwd (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 ceph rtd unknown /proc/72137/root (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 ceph txt unknown /proc/72137/exe (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 ceph NOFD /proc/72137/fd (opendir: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72138 log ceph cwd unknown /proc/72137/task/72138/cwd (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72138 log ceph rtd unknown /proc/72137/task/72138/root (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72138 log ceph txt unknown /proc/72137/task/72138/exe (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72138 log ceph NOFD /proc/72137/task/72138/fd (opendir: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72140 msgr-work ceph cwd unknown /proc/72137/task/72140/cwd (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72140 msgr-work ceph rtd unknown /proc/72137/task/72140/root (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72140 msgr-work ceph txt unknown /proc/72137/task/72140/exe (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72140 msgr-work ceph NOFD /proc/72137/task/72140/fd (opendir: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72141 msgr-work ceph cwd unknown /proc/72137/task/72141/cwd (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72141 msgr-work ceph rtd unknown /proc/72137/task/72141/root (readlink: Permission denied) 2024-09-21T07:08:34.818 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72141 msgr-work ceph txt unknown /proc/72137/task/72141/exe (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72141 msgr-work ceph NOFD /proc/72137/task/72141/fd (opendir: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72142 msgr-work ceph cwd unknown /proc/72137/task/72142/cwd (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72142 msgr-work ceph rtd unknown /proc/72137/task/72142/root (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72142 msgr-work ceph txt unknown /proc/72137/task/72142/exe (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72142 msgr-work ceph NOFD /proc/72137/task/72142/fd (opendir: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72146 service ceph cwd unknown /proc/72137/task/72146/cwd (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72146 service ceph rtd unknown /proc/72137/task/72146/root (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72146 service ceph txt unknown /proc/72137/task/72146/exe (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72146 service ceph NOFD /proc/72137/task/72146/fd (opendir: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72147 admin_soc ceph cwd unknown /proc/72137/task/72147/cwd (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72147 admin_soc ceph rtd unknown /proc/72137/task/72147/root (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72147 admin_soc ceph txt unknown /proc/72137/task/72147/exe (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72147 admin_soc ceph NOFD /proc/72137/task/72147/fd (opendir: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72148 signal_ha ceph cwd unknown /proc/72137/task/72148/cwd (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72148 signal_ha ceph rtd unknown /proc/72137/task/72148/root (readlink: Permission denied) 2024-09-21T07:08:34.819 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72148 signal_ha ceph txt unknown /proc/72137/task/72148/exe (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72148 signal_ha ceph NOFD /proc/72137/task/72148/fd (opendir: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72149 io_contex ceph cwd unknown /proc/72137/task/72149/cwd (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72149 io_contex ceph rtd unknown /proc/72137/task/72149/root (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72149 io_contex ceph txt unknown /proc/72137/task/72149/exe (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72149 io_contex ceph NOFD /proc/72137/task/72149/fd (opendir: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72150 io_contex ceph cwd unknown /proc/72137/task/72150/cwd (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72150 io_contex ceph rtd unknown /proc/72137/task/72150/root (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72150 io_contex ceph txt unknown /proc/72137/task/72150/exe (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72150 io_contex ceph NOFD /proc/72137/task/72150/fd (opendir: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72151 ms_dispat ceph cwd unknown /proc/72137/task/72151/cwd (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72151 ms_dispat ceph rtd unknown /proc/72137/task/72151/root (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72151 ms_dispat ceph txt unknown /proc/72137/task/72151/exe (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72151 ms_dispat ceph NOFD /proc/72137/task/72151/fd (opendir: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72152 ms_local ceph cwd unknown /proc/72137/task/72152/cwd (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72152 ms_local ceph rtd unknown /proc/72137/task/72152/root (readlink: Permission denied) 2024-09-21T07:08:34.820 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72152 ms_local ceph txt unknown /proc/72137/task/72152/exe (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72152 ms_local ceph NOFD /proc/72137/task/72152/fd (opendir: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72153 safe_time ceph cwd unknown /proc/72137/task/72153/cwd (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72153 safe_time ceph rtd unknown /proc/72137/task/72153/root (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72153 safe_time ceph txt unknown /proc/72137/task/72153/exe (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72153 safe_time ceph NOFD /proc/72137/task/72153/fd (opendir: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72154 safe_time ceph cwd unknown /proc/72137/task/72154/cwd (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72154 safe_time ceph rtd unknown /proc/72137/task/72154/root (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72154 safe_time ceph txt unknown /proc/72137/task/72154/exe (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72154 safe_time ceph NOFD /proc/72137/task/72154/fd (opendir: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72155 ceph-mds ceph cwd unknown /proc/72137/task/72155/cwd (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72155 ceph-mds ceph rtd unknown /proc/72137/task/72155/root (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72155 ceph-mds ceph txt unknown /proc/72137/task/72155/exe (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72155 ceph-mds ceph NOFD /proc/72137/task/72155/fd (opendir: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72303 safe_time ceph cwd unknown /proc/72137/task/72303/cwd (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72303 safe_time ceph rtd unknown /proc/72137/task/72303/root (readlink: Permission denied) 2024-09-21T07:08:34.821 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72303 safe_time ceph txt unknown /proc/72137/task/72303/exe (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72137 72303 safe_time ceph NOFD /proc/72137/task/72303/fd (opendir: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72473 root cwd unknown /proc/72473/cwd (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72473 root rtd unknown /proc/72473/root (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72473 root txt unknown /proc/72473/exe (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:conmon 72473 root NOFD /proc/72473/fd (opendir: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72475 root cwd unknown /proc/72475/cwd (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72475 root rtd unknown /proc/72475/root (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72475 root txt unknown /proc/72475/exe (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:podman-in 72475 root NOFD /proc/72475/fd (opendir: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 ceph cwd unknown /proc/72477/cwd (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 ceph rtd unknown /proc/72477/root (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 ceph txt unknown /proc/72477/exe (readlink: Permission denied) 2024-09-21T07:08:34.822 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 ceph NOFD /proc/72477/fd (opendir: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72478 log ceph cwd unknown /proc/72477/task/72478/cwd (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72478 log ceph rtd unknown /proc/72477/task/72478/root (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72478 log ceph txt unknown /proc/72477/task/72478/exe (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72478 log ceph NOFD /proc/72477/task/72478/fd (opendir: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72480 msgr-work ceph cwd unknown /proc/72477/task/72480/cwd (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72480 msgr-work ceph rtd unknown /proc/72477/task/72480/root (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72480 msgr-work ceph txt unknown /proc/72477/task/72480/exe (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72480 msgr-work ceph NOFD /proc/72477/task/72480/fd (opendir: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72481 msgr-work ceph cwd unknown /proc/72477/task/72481/cwd (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72481 msgr-work ceph rtd unknown /proc/72477/task/72481/root (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72481 msgr-work ceph txt unknown /proc/72477/task/72481/exe (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72481 msgr-work ceph NOFD /proc/72477/task/72481/fd (opendir: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72482 msgr-work ceph cwd unknown /proc/72477/task/72482/cwd (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72482 msgr-work ceph rtd unknown /proc/72477/task/72482/root (readlink: Permission denied) 2024-09-21T07:08:34.823 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72482 msgr-work ceph txt unknown /proc/72477/task/72482/exe (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72482 msgr-work ceph NOFD /proc/72477/task/72482/fd (opendir: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72486 service ceph cwd unknown /proc/72477/task/72486/cwd (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72486 service ceph rtd unknown /proc/72477/task/72486/root (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72486 service ceph txt unknown /proc/72477/task/72486/exe (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72486 service ceph NOFD /proc/72477/task/72486/fd (opendir: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72487 admin_soc ceph cwd unknown /proc/72477/task/72487/cwd (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72487 admin_soc ceph rtd unknown /proc/72477/task/72487/root (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72487 admin_soc ceph txt unknown /proc/72477/task/72487/exe (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72487 admin_soc ceph NOFD /proc/72477/task/72487/fd (opendir: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72488 signal_ha ceph cwd unknown /proc/72477/task/72488/cwd (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72488 signal_ha ceph rtd unknown /proc/72477/task/72488/root (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72488 signal_ha ceph txt unknown /proc/72477/task/72488/exe (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72488 signal_ha ceph NOFD /proc/72477/task/72488/fd (opendir: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72489 io_contex ceph cwd unknown /proc/72477/task/72489/cwd (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72489 io_contex ceph rtd unknown /proc/72477/task/72489/root (readlink: Permission denied) 2024-09-21T07:08:34.824 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72489 io_contex ceph txt unknown /proc/72477/task/72489/exe (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72489 io_contex ceph NOFD /proc/72477/task/72489/fd (opendir: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72490 io_contex ceph cwd unknown /proc/72477/task/72490/cwd (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72490 io_contex ceph rtd unknown /proc/72477/task/72490/root (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72490 io_contex ceph txt unknown /proc/72477/task/72490/exe (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72490 io_contex ceph NOFD /proc/72477/task/72490/fd (opendir: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72491 ms_dispat ceph cwd unknown /proc/72477/task/72491/cwd (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72491 ms_dispat ceph rtd unknown /proc/72477/task/72491/root (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72491 ms_dispat ceph txt unknown /proc/72477/task/72491/exe (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72491 ms_dispat ceph NOFD /proc/72477/task/72491/fd (opendir: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72492 ms_local ceph cwd unknown /proc/72477/task/72492/cwd (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72492 ms_local ceph rtd unknown /proc/72477/task/72492/root (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72492 ms_local ceph txt unknown /proc/72477/task/72492/exe (readlink: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72492 ms_local ceph NOFD /proc/72477/task/72492/fd (opendir: Permission denied) 2024-09-21T07:08:34.825 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72493 safe_time ceph cwd unknown /proc/72477/task/72493/cwd (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72493 safe_time ceph rtd unknown /proc/72477/task/72493/root (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72493 safe_time ceph txt unknown /proc/72477/task/72493/exe (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72493 safe_time ceph NOFD /proc/72477/task/72493/fd (opendir: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72494 safe_time ceph cwd unknown /proc/72477/task/72494/cwd (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72494 safe_time ceph rtd unknown /proc/72477/task/72494/root (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72494 safe_time ceph txt unknown /proc/72477/task/72494/exe (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72494 safe_time ceph NOFD /proc/72477/task/72494/fd (opendir: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72495 ceph-mds ceph cwd unknown /proc/72477/task/72495/cwd (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72495 ceph-mds ceph rtd unknown /proc/72477/task/72495/root (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72495 ceph-mds ceph txt unknown /proc/72477/task/72495/exe (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72495 ceph-mds ceph NOFD /proc/72477/task/72495/fd (opendir: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72518 safe_time ceph cwd unknown /proc/72477/task/72518/cwd (readlink: Permission denied) 2024-09-21T07:08:34.826 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72518 safe_time ceph rtd unknown /proc/72477/task/72518/root (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72518 safe_time ceph txt unknown /proc/72477/task/72518/exe (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 72518 safe_time ceph NOFD /proc/72477/task/72518/fd (opendir: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74352 ceph_time ceph cwd unknown /proc/72477/task/74352/cwd (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74352 ceph_time ceph rtd unknown /proc/72477/task/74352/root (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74352 ceph_time ceph txt unknown /proc/72477/task/74352/exe (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74352 ceph_time ceph NOFD /proc/72477/task/74352/fd (opendir: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74353 OpHistory ceph cwd unknown /proc/72477/task/74353/cwd (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74353 OpHistory ceph rtd unknown /proc/72477/task/74353/root (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74353 OpHistory ceph txt unknown /proc/72477/task/74353/exe (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74353 OpHistory ceph NOFD /proc/72477/task/74353/fd (opendir: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74354 ms_dispat ceph cwd unknown /proc/72477/task/74354/cwd (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74354 ms_dispat ceph rtd unknown /proc/72477/task/74354/root (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74354 ms_dispat ceph txt unknown /proc/72477/task/74354/exe (readlink: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74354 ms_dispat ceph NOFD /proc/72477/task/74354/fd (opendir: Permission denied) 2024-09-21T07:08:34.827 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74355 ms_dispat ceph cwd unknown /proc/72477/task/74355/cwd (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74355 ms_dispat ceph rtd unknown /proc/72477/task/74355/root (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74355 ms_dispat ceph txt unknown /proc/72477/task/74355/exe (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74355 ms_dispat ceph NOFD /proc/72477/task/74355/fd (opendir: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74356 mds_rank_ ceph cwd unknown /proc/72477/task/74356/cwd (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74356 mds_rank_ ceph rtd unknown /proc/72477/task/74356/root (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74356 mds_rank_ ceph txt unknown /proc/72477/task/74356/exe (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74356 mds_rank_ ceph NOFD /proc/72477/task/74356/fd (opendir: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74357 PQ_Finish ceph cwd unknown /proc/72477/task/74357/cwd (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74357 PQ_Finish ceph rtd unknown /proc/72477/task/74357/root (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74357 PQ_Finish ceph txt unknown /proc/72477/task/74357/exe (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74357 PQ_Finish ceph NOFD /proc/72477/task/74357/fd (opendir: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74358 safe_time ceph cwd unknown /proc/72477/task/74358/cwd (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74358 safe_time ceph rtd unknown /proc/72477/task/74358/root (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74358 safe_time ceph txt unknown /proc/72477/task/74358/exe (readlink: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74358 safe_time ceph NOFD /proc/72477/task/74358/fd (opendir: Permission denied) 2024-09-21T07:08:34.828 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74359 MR_Finish ceph cwd unknown /proc/72477/task/74359/cwd (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74359 MR_Finish ceph rtd unknown /proc/72477/task/74359/root (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74359 MR_Finish ceph txt unknown /proc/72477/task/74359/exe (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74359 MR_Finish ceph NOFD /proc/72477/task/74359/fd (opendir: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74360 md_submit ceph cwd unknown /proc/72477/task/74360/cwd (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74360 md_submit ceph rtd unknown /proc/72477/task/74360/root (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74360 md_submit ceph txt unknown /proc/72477/task/74360/exe (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74360 md_submit ceph NOFD /proc/72477/task/74360/fd (opendir: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74458 ms_dispat ceph cwd unknown /proc/72477/task/74458/cwd (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74458 ms_dispat ceph rtd unknown /proc/72477/task/74458/root (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74458 ms_dispat ceph txt unknown /proc/72477/task/74458/exe (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74458 ms_dispat ceph NOFD /proc/72477/task/74458/fd (opendir: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74459 quiesce.a ceph cwd unknown /proc/72477/task/74459/cwd (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74459 quiesce.a ceph rtd unknown /proc/72477/task/74459/root (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74459 quiesce.a ceph txt unknown /proc/72477/task/74459/exe (readlink: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74459 quiesce.a ceph NOFD /proc/72477/task/74459/fd (opendir: Permission denied) 2024-09-21T07:08:34.829 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74460 quiesce_d ceph cwd unknown /proc/72477/task/74460/cwd (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74460 quiesce_d ceph rtd unknown /proc/72477/task/74460/root (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74460 quiesce_d ceph txt unknown /proc/72477/task/74460/exe (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:ceph-mds 72477 74460 quiesce_d ceph NOFD /proc/72477/task/74460/fd (opendir: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 74237 root cwd unknown /proc/74237/cwd (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 74237 root rtd unknown /proc/74237/root (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 74237 root txt unknown /proc/74237/exe (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/2 74237 root NOFD /proc/74237/fd (opendir: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 74958 root cwd unknown /proc/74958/cwd (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 74958 root rtd unknown /proc/74958/root (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 74958 root txt unknown /proc/74958/exe (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/u 74958 root NOFD /proc/74958/fd (opendir: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 77446 root cwd unknown /proc/77446/cwd (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 77446 root rtd unknown /proc/77446/root (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 77446 root txt unknown /proc/77446/exe (readlink: Permission denied) 2024-09-21T07:08:34.830 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 77446 root NOFD /proc/77446/fd (opendir: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 77743 root cwd unknown /proc/77743/cwd (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 77743 root rtd unknown /proc/77743/root (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 77743 root txt unknown /proc/77743/exe (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/5 77743 root NOFD /proc/77743/fd (opendir: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 81397 root cwd unknown /proc/81397/cwd (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 81397 root rtd unknown /proc/81397/root (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 81397 root txt unknown /proc/81397/exe (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/4 81397 root NOFD /proc/81397/fd (opendir: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82564 root cwd unknown /proc/82564/cwd (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82564 root rtd unknown /proc/82564/root (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82564 root txt unknown /proc/82564/exe (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82564 root NOFD /proc/82564/fd (opendir: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82565 root cwd unknown /proc/82565/cwd (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82565 root rtd unknown /proc/82565/root (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82565 root txt unknown /proc/82565/exe (readlink: Permission denied) 2024-09-21T07:08:34.831 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82565 root NOFD /proc/82565/fd (opendir: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82566 root cwd unknown /proc/82566/cwd (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82566 root rtd unknown /proc/82566/root (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82566 root txt unknown /proc/82566/exe (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/R 82566 root NOFD /proc/82566/fd (opendir: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 82838 root cwd unknown /proc/82838/cwd (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 82838 root rtd unknown /proc/82838/root (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 82838 root txt unknown /proc/82838/exe (readlink: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:kworker/7 82838 root NOFD /proc/82838/fd (opendir: Permission denied) 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T07:08:34.832 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu 0r FIFO 0,13 0t0 229047 pipe 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu 1w FIFO 0,13 0t0 229048 pipe 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:timeout 83336 ubuntu 2w FIFO 0,13 0t0 229049 pipe 2024-09-21T07:08:34.833 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T07:08:34.834 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu 0r FIFO 0,13 0t0 229047 pipe 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu 1w FIFO 0,13 0t0 229048 pipe 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu 2w FIFO 0,13 0t0 229049 pipe 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:fsync-tes 83354 ubuntu 255r REG 8,1 207 661543 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T07:08:34.835 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 0r FIFO 0,13 0t0 229047 pipe 2024-09-21T07:08:34.836 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 1w FIFO 0,13 0t0 229048 pipe 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 2w FIFO 0,13 0t0 229049 pipe 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 4r DIR 0,20 0 226777 /proc/83510/fd 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 5w FIFO 0,13 0t0 226782 pipe 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83510 ubuntu 6r FIFO 0,13 0t0 226783 pipe 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T07:08:34.837 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu 4r FIFO 0,13 0t0 226782 pipe 2024-09-21T07:08:34.838 INFO:tasks.workunit.client.0.smithi028.stdout:lsof 83511 ubuntu 7w FIFO 0,13 0t0 226783 pipe 2024-09-21T07:08:34.838 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T07:08:34.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:08:34.883 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-21T07:08:34.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T07:08:35.182 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:35.182 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:08:35.211 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:08:35.212 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T07:08:35.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 -- 172.21.15.28:0/1775594555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20102570 msgr2=0x7f7d201029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1775594555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20102570 0x7f7d201029e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009900 tx=0x7f7d1002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 -- 172.21.15.28:0/1775594555 shutdown_connections 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1775594555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20103f90 0x7f7d2010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1775594555 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 0x7f7d20103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1775594555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20102570 0x7f7d201029e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 -- 172.21.15.28:0/1775594555 >> 172.21.15.28:0/1775594555 conn(0x7f7d200fdeb0 msgr2=0x7f7d20100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:35.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 -- 172.21.15.28:0/1775594555 shutdown_connections 2024-09-21T07:08:35.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.364+0000 7f7d25bba640 1 -- 172.21.15.28:0/1775594555 wait complete. 2024-09-21T07:08:35.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 Processor -- start 2024-09-21T07:08:35.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 -- start start 2024-09-21T07:08:35.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20102570 0x7f7d2006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 0x7f7d201a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2010e1a0 con 0x7f7d20103f90 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2010e020 con 0x7f7d201035f0 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.365+0000 7f7d25bba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2010e320 con 0x7f7d20102570 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54602/0 (socket says 172.21.15.28:54602) 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 -- 172.21.15.28:0/1088480237 learned_addr learned my addr 172.21.15.28:0/1088480237 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1effd640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 0x7f7d201a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1f7fe640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20102570 0x7f7d2006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 -- 172.21.15.28:0/1088480237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20102570 msgr2=0x7f7d2006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20102570 0x7f7d2006aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 -- 172.21.15.28:0/1088480237 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 msgr2=0x7f7d201a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 0x7f7d201a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 -- 172.21.15.28:0/1088480237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d201a3b70 con 0x7f7d20103f90 2024-09-21T07:08:35.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1ffff640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ead0 tx=0x7f7d1800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d18004d20 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d18005020 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d201a3e60 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180116d0 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.366+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d201a42d0 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.368+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d20109740 con 0x7f7d20103f90 2024-09-21T07:08:35.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.369+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7d180051d0 con 0x7f7d20103f90 2024-09-21T07:08:35.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.370+0000 7f7d1cff9640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 0x7f7d080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.371+0000 7f7d1f7fe640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 0x7f7d080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.371+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7d180e78b0 con 0x7f7d20103f90 2024-09-21T07:08:35.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.371+0000 7f7d1f7fe640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 0x7f7d080b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d10031440 tx=0x7f7d100314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.374+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d18016030 con 0x7f7d20103f90 2024-09-21T07:08:35.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.563+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d2002e810 con 0x7f7d20103f90 2024-09-21T07:08:35.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.566+0000 7f7d1cff9640 1 -- 172.21.15.28:0/1088480237 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7f7d180ae150 con 0x7f7d20103f90 2024-09-21T07:08:35.567 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:08:35.567 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:08:35.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 msgr2=0x7f7d080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 0x7f7d080b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d10031440 tx=0x7f7d100314a0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 msgr2=0x7f7d201a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ead0 tx=0x7f7d1800eed0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 shutdown_connections 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7d080b6510 0x7f7d080b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d20103f90 0x7f7d201a35e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d201035f0 0x7f7d201a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 --2- 172.21.15.28:0/1088480237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d20102570 0x7f7d2006aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 >> 172.21.15.28:0/1088480237 conn(0x7f7d200fdeb0 msgr2=0x7f7d20106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 shutdown_connections 2024-09-21T07:08:35.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.568+0000 7f7d25bba640 1 -- 172.21.15.28:0/1088480237 wait complete. 2024-09-21T07:08:35.581 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:59:58.659335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:04:36.287210+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:04:38.714984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:08:35.581 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:08:35.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 -- 172.21.15.28:0/2382549772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103600 msgr2=0x7f17f0103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 --2- 172.21.15.28:0/2382549772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103600 0x7f17f0103a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009900 tx=0x7f17e002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 -- 172.21.15.28:0/2382549772 shutdown_connections 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 --2- 172.21.15.28:0/2382549772 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0103fa0 0x7f17f010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 --2- 172.21.15.28:0/2382549772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103600 0x7f17f0103a10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 --2- 172.21.15.28:0/2382549772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0102580 0x7f17f01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 -- 172.21.15.28:0/2382549772 >> 172.21.15.28:0/2382549772 conn(0x7f17f00fdee0 msgr2=0x7f17f0100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 -- 172.21.15.28:0/2382549772 shutdown_connections 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.697+0000 7f17f7739640 1 -- 172.21.15.28:0/2382549772 wait complete. 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 Processor -- start 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 -- start start 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0102580 0x7f17f006c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 0x7f17f019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010e1e0 con 0x7f17f0103fa0 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010e060 con 0x7f17f0103600 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f7739640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010e360 con 0x7f17f0102580 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54620/0 (socket says 172.21.15.28:54620) 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 -- 172.21.15.28:0/3786648798 learned_addr learned my addr 172.21.15.28:0/3786648798 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f4cd4640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 0x7f17f019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f54d5640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0102580 0x7f17f006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 -- 172.21.15.28:0/3786648798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0102580 msgr2=0x7f17f006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0102580 0x7f17f006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 -- 172.21.15.28:0/3786648798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 msgr2=0x7f17f019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 0x7f17f019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f5cd6640 1 -- 172.21.15.28:0/3786648798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f01a19c0 con 0x7f17f0103fa0 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.698+0000 7f17f4cd4640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 0x7f17f019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:35.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17f5cd6640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f17e800eaa0 tx=0x7f17e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e800cdb0 con 0x7f17f0103fa0 2024-09-21T07:08:35.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e8005020 con 0x7f17f0103fa0 2024-09-21T07:08:35.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01a1cb0 con 0x7f17f0103fa0 2024-09-21T07:08:35.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80116d0 con 0x7f17f0103fa0 2024-09-21T07:08:35.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.699+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01a21a0 con 0x7f17f0103fa0 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.700+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f0109730 con 0x7f17f0103fa0 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.701+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f17e80051d0 con 0x7f17f0103fa0 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.702+0000 7f17e67fc640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 0x7f17dc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.702+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f17e80e7890 con 0x7f17f0103fa0 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.702+0000 7f17f54d5640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 0x7f17dc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.703+0000 7f17f54d5640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 0x7f17dc0b8aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.705+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17e8016030 con 0x7f17f0103fa0 2024-09-21T07:08:35.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:35 smithi129 ceph-mon[34863]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:35.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.895+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17f0063ff0 con 0x7f17f0103fa0 2024-09-21T07:08:35.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.895+0000 7f17e67fc640 1 -- 172.21.15.28:0/3786648798 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f17e80a9030 con 0x7f17f0103fa0 2024-09-21T07:08:35.897 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 msgr2=0x7f17dc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 0x7f17dc0b8aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec005850 comp rx=0 tx=0).stop 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 msgr2=0x7f17f01a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f17e800eaa0 tx=0x7f17e800ef60 comp rx=0 tx=0).stop 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 shutdown_connections 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f17dc0b6590 0x7f17dc0b8aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17f0103fa0 0x7f17f01a11a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17f0103600 0x7f17f019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 --2- 172.21.15.28:0/3786648798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17f0102580 0x7f17f006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.897+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 >> 172.21.15.28:0/3786648798 conn(0x7f17f00fdee0 msgr2=0x7f17f0106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.898+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 shutdown_connections 2024-09-21T07:08:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:35.898+0000 7f17f7739640 1 -- 172.21.15.28:0/3786648798 wait complete. 2024-09-21T07:08:35.909 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:35 smithi028 ceph-mon[31213]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:35.910 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:08:36.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:35 smithi181 ceph-mon[34686]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 862 KiB/s wr, 10 op/s 2024-09-21T07:08:36.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 -- 172.21.15.28:0/1208584304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103fa0 msgr2=0x7f626410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 --2- 172.21.15.28:0/1208584304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103fa0 0x7f626410a940 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f625c009ca0 tx=0x7f625c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 -- 172.21.15.28:0/1208584304 shutdown_connections 2024-09-21T07:08:36.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 --2- 172.21.15.28:0/1208584304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103fa0 0x7f626410a940 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 --2- 172.21.15.28:0/1208584304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264103600 0x7f6264103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 --2- 172.21.15.28:0/1208584304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264102580 0x7f62641029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 -- 172.21.15.28:0/1208584304 >> 172.21.15.28:0/1208584304 conn(0x7f62640fdee0 msgr2=0x7f6264100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 -- 172.21.15.28:0/1208584304 shutdown_connections 2024-09-21T07:08:36.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 -- 172.21.15.28:0/1208584304 wait complete. 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.025+0000 7f626a894640 1 Processor -- start 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 -- start start 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264102580 0x7f626406af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 0x7f62641a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f626410e1c0 con 0x7f6264103600 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f626410e040 con 0x7f6264102580 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f626a894640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f626410e340 con 0x7f6264103fa0 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54634/0 (socket says 172.21.15.28:54634) 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 -- 172.21.15.28:0/240778971 learned_addr learned my addr 172.21.15.28:0/240778971 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f6263fff640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264102580 0x7f626406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f6268e31640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 0x7f62641a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 -- 172.21.15.28:0/240778971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 msgr2=0x7f62641a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 0x7f62641a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 -- 172.21.15.28:0/240778971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264102580 msgr2=0x7f626406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264102580 0x7f626406af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f62637fe640 1 -- 172.21.15.28:0/240778971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641a1940 con 0x7f6264103600 2024-09-21T07:08:36.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.026+0000 7f6268e31640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 0x7f62641a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f62637fe640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258017070 con 0x7f6264103600 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6258009c30 con 0x7f6264103600 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625800f620 con 0x7f6264103600 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641a1c30 con 0x7f6264103600 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.027+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641a21d0 con 0x7f6264103600 2024-09-21T07:08:36.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.028+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6264109750 con 0x7f6264103600 2024-09-21T07:08:36.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.029+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f6258010460 con 0x7f6264103600 2024-09-21T07:08:36.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.030+0000 7f62617fa640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 0x7f624c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.030+0000 7f6263fff640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 0x7f624c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.030+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f62580e6f10 con 0x7f6264103600 2024-09-21T07:08:36.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.031+0000 7f6263fff640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 0x7f624c0b8aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f625400bbe0 tx=0x7f625400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.035+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62580ad750 con 0x7f6264103600 2024-09-21T07:08:36.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.227+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6264063fc0 con 0x7f6264103600 2024-09-21T07:08:36.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.227+0000 7f62617fa640 1 -- 172.21.15.28:0/240778971 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f6258009de0 con 0x7f6264103600 2024-09-21T07:08:36.229 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 msgr2=0x7f624c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 0x7f624c0b8aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f625400bbe0 tx=0x7f625400b390 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 msgr2=0x7f626419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f625800d950 tx=0x7f625800de10 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 shutdown_connections 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f624c0b6590 0x7f624c0b8aa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6264103fa0 0x7f62641a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6264103600 0x7f626419ebf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 --2- 172.21.15.28:0/240778971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6264102580 0x7f626406af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.229+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 >> 172.21.15.28:0/240778971 conn(0x7f62640fdee0 msgr2=0x7f6264106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.230+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 shutdown_connections 2024-09-21T07:08:36.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.230+0000 7f626a894640 1 -- 172.21.15.28:0/240778971 wait complete. 2024-09-21T07:08:36.242 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 -- 172.21.15.28:0/4077576703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 msgr2=0x7f573010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 --2- 172.21.15.28:0/4077576703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573010ba60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5728009ca0 tx=0x7f572802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 -- 172.21.15.28:0/4077576703 shutdown_connections 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 --2- 172.21.15.28:0/4077576703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573010ba60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 --2- 172.21.15.28:0/4077576703 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5730104720 0x7f5730104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 --2- 172.21.15.28:0/4077576703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57301036a0 0x7f5730103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 -- 172.21.15.28:0/4077576703 >> 172.21.15.28:0/4077576703 conn(0x7f57300fefe0 msgr2=0x7f5730101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 -- 172.21.15.28:0/4077576703 shutdown_connections 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.358+0000 7f57384f9640 1 -- 172.21.15.28:0/4077576703 wait complete. 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 Processor -- start 2024-09-21T07:08:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 -- start start 2024-09-21T07:08:36.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57301036a0 0x7f5730199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 0x7f573019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f573010f2f0 con 0x7f57301050c0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f573010f170 con 0x7f57301036a0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f57384f9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f573010f470 con 0x7f5730104720 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54654/0 (socket says 172.21.15.28:54654) 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 -- 172.21.15.28:0/2530724330 learned_addr learned my addr 172.21.15.28:0/2530724330 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736295640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57301036a0 0x7f5730199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5735a94640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 0x7f573019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 -- 172.21.15.28:0/2530724330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 msgr2=0x7f573019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 0x7f573019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 -- 172.21.15.28:0/2530724330 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57301036a0 msgr2=0x7f5730199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57301036a0 0x7f5730199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5736a96640 1 -- 172.21.15.28:0/2530724330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573019b8c0 con 0x7f57301050c0 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.359+0000 7f5735a94640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 0x7f573019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f5736a96640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f57280097b0 tx=0x7f5728003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728004240 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57280317c0 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573019bb50 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572802fc30 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.360+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57301a2150 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.361+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573010a870 con 0x7f57301050c0 2024-09-21T07:08:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.363+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f57280043e0 con 0x7f57301050c0 2024-09-21T07:08:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.363+0000 7f57277fe640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 0x7f571c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.363+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5728108990 con 0x7f57301050c0 2024-09-21T07:08:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.363+0000 7f5736295640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 0x7f571c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.364+0000 7f5736295640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 0x7f571c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f572c005fd0 tx=0x7f572c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.367+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57280cf230 con 0x7f57301050c0 2024-09-21T07:08:36.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.557+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5730063fc0 con 0x7f57301050c0 2024-09-21T07:08:36.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.558+0000 7f57277fe640 1 -- 172.21.15.28:0/2530724330 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f57280d3610 con 0x7f57301050c0 2024-09-21T07:08:36.559 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-09-21T07:08:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 msgr2=0x7f571c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 0x7f571c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f572c005fd0 tx=0x7f572c00b390 comp rx=0 tx=0).stop 2024-09-21T07:08:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 msgr2=0x7f573019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f57280097b0 tx=0x7f5728003c20 comp rx=0 tx=0).stop 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 shutdown_connections 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f571c0b6510 0x7f571c0b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57301050c0 0x7f573019b130 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5730104720 0x7f573019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 --2- 172.21.15.28:0/2530724330 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57301036a0 0x7f5730199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 >> 172.21.15.28:0/2530724330 conn(0x7f57300fefe0 msgr2=0x7f5730107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 shutdown_connections 2024-09-21T07:08:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.560+0000 7f57384f9640 1 -- 172.21.15.28:0/2530724330 wait complete. 2024-09-21T07:08:36.576 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 -- 172.21.15.28:0/967343561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff928103fc0 msgr2=0x7ff92810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 --2- 172.21.15.28:0/967343561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff928103fc0 0x7ff92810a960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff920009c90 tx=0x7ff92002a860 comp rx=0 tx=0).stop 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 -- 172.21.15.28:0/967343561 shutdown_connections 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 --2- 172.21.15.28:0/967343561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff928103fc0 0x7ff92810a960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 --2- 172.21.15.28:0/967343561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 --2- 172.21.15.28:0/967343561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9281025a0 0x7ff928102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 -- 172.21.15.28:0/967343561 >> 172.21.15.28:0/967343561 conn(0x7ff9280fdee0 msgr2=0x7ff928100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 -- 172.21.15.28:0/967343561 shutdown_connections 2024-09-21T07:08:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.687+0000 7ff92f64d640 1 -- 172.21.15.28:0/967343561 wait complete. 2024-09-21T07:08:36.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 Processor -- start 2024-09-21T07:08:36.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 -- start start 2024-09-21T07:08:36.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff928103fc0 0x7ff92819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810e240 con 0x7ff9281025a0 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810e0c0 con 0x7ff928103620 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92f64d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810e3c0 con 0x7ff928103fc0 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92d3e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92d3e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54662/0 (socket says 172.21.15.28:54662) 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.688+0000 7ff92d3e9640 1 -- 172.21.15.28:0/3230290577 learned_addr learned my addr 172.21.15.28:0/3230290577 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92cbe8640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92dbea640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff928103fc0 0x7ff92819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 -- 172.21.15.28:0/3230290577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff928103fc0 msgr2=0x7ff92819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff928103fc0 0x7ff92819a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 -- 172.21.15.28:0/3230290577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 msgr2=0x7ff928199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 -- 172.21.15.28:0/3230290577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92819a820 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92cbe8640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92d3e9640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d770 tx=0x7ff92400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924017070 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92819ab10 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9240054d0 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924004c30 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.689+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9281a1200 con 0x7ff9281025a0 2024-09-21T07:08:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.690+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff928109770 con 0x7ff9281025a0 2024-09-21T07:08:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.692+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7ff924004dd0 con 0x7ff9281025a0 2024-09-21T07:08:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.693+0000 7ff91e7fc640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 0x7ff9140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.693+0000 7ff92cbe8640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 0x7ff9140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.693+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff9240e7290 con 0x7ff9281025a0 2024-09-21T07:08:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.693+0000 7ff92cbe8640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 0x7ff9140b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff9180058c0 tx=0x7ff918005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:36.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.696+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9240adb30 con 0x7ff9281025a0 2024-09-21T07:08:36.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/1088480237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:36.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3786648798' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:08:36.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/240778971' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:08:36.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:36 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2530724330' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:08:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.934+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff928063fc0 con 0x7ff9281025a0 2024-09-21T07:08:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.942+0000 7ff91e7fc640 1 -- 172.21.15.28:0/3230290577 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+833522 (secure 0 0 0) 0x7ff9240b1f10 con 0x7ff9281025a0 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 20, 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "active_gid": 14152, 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "active_name": "x", 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "active_addrs": { 2024-09-21T07:08:36.953 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6800", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2420223587 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6801", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2420223587 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "active_addr": "172.21.15.28:6801/2420223587", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "active_change": "2024-09-21T06:57:12.165003+0000", 2024-09-21T07:08:36.954 INFO:teuthology.orchestra.run.smithi028.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "available": true, 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "standbys": [ 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "gid": 24115, 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "z", 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:36.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:36.956 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.957 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.958 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:36.959 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.960 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.961 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.962 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.963 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.964 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.965 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.966 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.967 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.968 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.969 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.970 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-09-21T07:08:36.971 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:36.972 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-09-21T07:08:36.973 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.974 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:08:36.975 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:36.976 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:36.977 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:36.978 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.979 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.980 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-09-21T07:08:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.987 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-09-21T07:08:36.988 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:36.989 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.990 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.991 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.992 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.993 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.994 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.995 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:36.996 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:08:36.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.998 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:36.999 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.000 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-09-21T07:08:37.001 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-09-21T07:08:37.002 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-09-21T07:08:37.003 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.004 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:08:37.005 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:08:37.006 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.008 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nginx": { 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nginx", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nginx container image", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.009 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.010 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:08:37.011 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.012 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.013 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba_metrics": { 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.015 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:08:37.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.017 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.018 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-09-21T07:08:37.019 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:08:37.020 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-09-21T07:08:37.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-09-21T07:08:37.024 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.025 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.026 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.027 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.028 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.029 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.030 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.031 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.032 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.033 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.034 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.035 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.036 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-09-21T07:08:37.037 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.038 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.039 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.040 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.041 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:08:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.045 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.046 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.047 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_interval": { 2024-09-21T07:08:37.048 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.049 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.050 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.051 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.052 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.053 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.054 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.055 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.056 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.057 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.058 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-09-21T07:08:37.059 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.060 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.061 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:08:37.062 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.063 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.064 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.065 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.066 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.067 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.068 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.069 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.070 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.071 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.072 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:08:37.073 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:08:37.074 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.075 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.076 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.077 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.078 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.079 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.080 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:08:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "[]", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:08:37.083 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "{}", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.084 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.085 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.086 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.087 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.088 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.089 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.090 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.091 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.092 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.093 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.097 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.098 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.099 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.101 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.102 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.103 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.104 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-09-21T07:08:37.105 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-09-21T07:08:37.106 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.107 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-09-21T07:08:37.108 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.109 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.110 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.111 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.117 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.118 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.119 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.120 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "sso_oauth2": { 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sso_oauth2", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.121 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-09-21T07:08:37.122 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.123 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.124 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.125 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.126 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.127 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.128 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.129 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-09-21T07:08:37.131 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.132 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.133 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.134 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.135 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.136 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-09-21T07:08:37.137 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.138 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.139 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.140 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.141 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.142 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.143 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.144 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.145 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.146 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-09-21T07:08:37.147 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-09-21T07:08:37.148 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.149 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.150 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.152 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.153 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.154 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.155 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.156 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.157 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.159 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:08:37.160 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.161 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.162 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.163 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.164 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.165 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.166 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.167 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.168 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.169 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.170 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.171 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.172 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.173 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.174 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:08:37.175 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.176 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.177 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.178 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.179 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.180 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.181 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.182 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.183 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.184 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.186 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.187 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.188 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-09-21T07:08:37.189 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-09-21T07:08:37.190 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.191 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.192 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.193 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.194 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.195 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.196 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.197 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.198 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.200 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.201 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.202 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.203 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.204 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-09-21T07:08:37.205 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.206 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.207 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.208 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.209 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.210 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.211 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:08:37.212 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.213 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.214 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.215 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.216 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:37.217 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.218 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.219 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.220 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.221 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.222 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.223 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.224 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.225 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.226 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.227 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.228 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.229 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.230 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-09-21T07:08:37.231 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.232 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.233 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.234 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.235 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.236 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.237 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-09-21T07:08:37.238 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.239 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:08:37.240 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.241 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.242 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.243 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.244 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.245 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.246 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.247 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.248 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.249 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.250 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.251 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.252 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.253 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.254 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.255 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:08:37.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.257 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.259 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.260 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.261 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-09-21T07:08:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.263 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.264 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.265 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.266 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.267 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.268 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:08:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.270 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.271 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.272 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:37.273 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.274 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.275 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.276 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.277 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.278 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "max_requests": { 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_requests", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:08:37.279 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.280 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.281 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.282 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.283 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.284 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.285 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.286 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.287 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.288 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.289 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.290 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.291 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.292 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.293 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.294 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.295 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.296 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.297 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.298 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.299 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.300 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.301 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.302 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.303 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.304 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.305 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.306 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.307 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.308 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-09-21T07:08:37.309 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.310 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-09-21T07:08:37.311 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-09-21T07:08:37.312 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.313 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smb", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "internal_store_backend": { 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "internal_store_backend", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.315 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.316 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.317 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.318 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.319 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.320 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "update_orchestration": { 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "update_orchestration", 2024-09-21T07:08:37.321 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-09-21T07:08:37.322 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.323 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.324 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.325 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.326 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.327 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.328 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.329 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.331 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.332 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.333 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.334 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.335 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.336 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.337 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.338 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.339 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.340 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.341 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.342 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.343 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.344 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.345 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.346 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.347 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.348 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.349 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.350 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.351 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:08:37.352 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.353 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.354 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-09-21T07:08:37.355 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.356 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.357 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.358 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.359 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.360 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.361 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.362 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.364 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.365 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.366 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.367 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.368 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.369 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.370 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.371 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.372 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.373 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.373 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.373 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.373 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.373 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.374 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.375 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.376 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.377 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.378 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.379 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.380 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.381 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.383 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-09-21T07:08:37.384 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:08:37.385 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.386 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-09-21T07:08:37.387 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.388 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.389 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.390 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.391 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.392 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.393 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.394 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.395 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.396 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-09-21T07:08:37.397 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.398 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "gid": 24143, 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "y", 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.399 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.400 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.401 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.402 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.403 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.404 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:08:37.405 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-09-21T07:08:37.406 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.407 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.408 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.409 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-09-21T07:08:37.410 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.411 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.412 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.413 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.414 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-09-21T07:08:37.415 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:08:37.416 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.417 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.418 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-09-21T07:08:37.419 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.421 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.422 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.423 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.424 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.425 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.426 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.427 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.430 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.431 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.432 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-09-21T07:08:37.433 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-09-21T07:08:37.434 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-09-21T07:08:37.435 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-09-21T07:08:37.436 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:08:37.437 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-09-21T07:08:37.438 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.439 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.440 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.441 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-09-21T07:08:37.442 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-09-21T07:08:37.443 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-09-21T07:08:37.444 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.445 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.446 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:08:37.447 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.448 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.449 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nginx": { 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nginx", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nginx container image", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:08:37.455 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.456 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.457 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba_metrics": { 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.458 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.459 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.460 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.461 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.462 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.464 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.465 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-09-21T07:08:37.466 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.467 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.469 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-09-21T07:08:37.470 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.471 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.472 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.473 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:08:37.474 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.475 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.476 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.477 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.478 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.479 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.480 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.481 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:08:37.482 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.483 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-09-21T07:08:37.484 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.485 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-09-21T07:08:37.486 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.487 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:08:37.488 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.489 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_interval": { 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.490 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-09-21T07:08:37.491 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:08:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.493 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.494 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.495 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.496 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.497 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.498 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.499 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.500 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.501 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:08:37.502 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.503 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.504 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.505 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.506 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.507 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.508 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.509 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.510 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.511 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.512 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.514 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:08:37.515 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:08:37.516 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:08:37.517 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.518 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.519 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.521 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.522 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.523 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.524 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "[]", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.525 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "{}", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.526 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.527 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.528 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.529 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.530 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:08:37.531 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:08:37.532 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.533 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.534 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.535 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.536 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.537 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.538 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.539 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.540 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.541 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.542 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:08:37.543 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:08:37.544 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.545 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.546 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.547 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.548 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:08:37.549 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.550 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.551 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.552 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.553 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.554 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.555 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-09-21T07:08:37.556 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.557 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.558 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.559 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.560 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.561 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.562 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "sso_oauth2": { 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sso_oauth2", 2024-09-21T07:08:37.563 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:37.564 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.565 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.567 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.568 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.569 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.570 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.571 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.572 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.573 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.574 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.575 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.576 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.577 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.578 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.579 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:08:37.580 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.581 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.582 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.583 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.584 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.585 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.586 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.587 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.588 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.589 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.590 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.591 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.592 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.593 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:08:37.594 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:08:37.595 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.596 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.597 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.598 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.599 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-09-21T07:08:37.600 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.601 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.602 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-09-21T07:08:37.603 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.604 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.605 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.606 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.607 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.608 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.609 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.610 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.611 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.612 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.613 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.614 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.615 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.616 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.617 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.618 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.619 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.620 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:08:37.621 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.622 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.623 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.624 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.625 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.626 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.627 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.628 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.629 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.630 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.631 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.632 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.634 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-09-21T07:08:37.635 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.638 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.639 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.640 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.641 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.642 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.643 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.644 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.645 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.646 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.647 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.648 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.649 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.650 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.651 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.652 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.653 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.655 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.656 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.657 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.658 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.659 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.660 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.661 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.662 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.663 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.664 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.665 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.666 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.667 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.668 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.669 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.670 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.671 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.673 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.674 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-09-21T07:08:37.675 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.676 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.677 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.678 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.679 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.680 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.681 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.682 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.683 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.684 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.685 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.686 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.687 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.688 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-09-21T07:08:37.689 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.690 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.691 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.692 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-09-21T07:08:37.693 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.694 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.695 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.696 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.697 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:08:37.699 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.700 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.701 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.702 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.703 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.704 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-09-21T07:08:37.705 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:37.706 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.707 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.708 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.709 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.710 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.711 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.712 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.713 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.714 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.715 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.716 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.717 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.718 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.719 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.720 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.721 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "max_requests": { 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_requests", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.723 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.725 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-09-21T07:08:37.726 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.727 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.728 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.729 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.730 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:08:37.731 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.732 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.733 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.734 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.735 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.736 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.737 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.738 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.739 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.740 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.741 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.742 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.743 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.744 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.745 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.746 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.747 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-09-21T07:08:37.748 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.749 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.750 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.751 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.752 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.753 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.754 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.755 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-09-21T07:08:37.756 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.757 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smb", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "internal_store_backend": { 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "internal_store_backend", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.758 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.759 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.760 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.761 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.763 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "update_orchestration": { 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "update_orchestration", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.764 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.765 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.766 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.767 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.768 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.769 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.770 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.771 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.772 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-09-21T07:08:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.787 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.788 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.789 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.790 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.791 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.792 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.793 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-09-21T07:08:37.794 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.795 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.796 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.797 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.798 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.799 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.800 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.801 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.802 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.803 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-09-21T07:08:37.804 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.805 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.806 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.807 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.808 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.809 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.810 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.811 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.812 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.816 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.817 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.818 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.819 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.820 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.821 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.822 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.823 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.824 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.825 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-09-21T07:08:37.826 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:08:37.827 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.828 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.829 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.830 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.831 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.832 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.833 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.834 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.835 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.836 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.837 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.838 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.839 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.840 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "modules": [ 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "dashboard", 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "iostat", 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "nfs", 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "restful" 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-09-21T07:08:37.841 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.842 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.843 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.844 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.845 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.846 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.847 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-09-21T07:08:37.848 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-09-21T07:08:37.850 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.851 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.852 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.853 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.854 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.855 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.856 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:37.857 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.858 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.859 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-09-21T07:08:37.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-09-21T07:08:37.861 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.862 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.864 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.865 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.866 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:08:37.867 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-09-21T07:08:37.868 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.869 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.870 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.871 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:08:37.872 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.873 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.874 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-09-21T07:08:37.875 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.876 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.877 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.878 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-09-21T07:08:37.879 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:08:37.880 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.881 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.882 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-09-21T07:08:37.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:08:37.884 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.885 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.886 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.887 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:08:37.888 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.889 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.890 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nginx": { 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nginx", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nginx container image", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-09-21T07:08:37.892 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.894 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.895 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.896 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.897 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba_metrics": { 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:08:37.898 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.899 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.900 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.901 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-09-21T07:08:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.903 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.905 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:08:37.906 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:08:37.907 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.908 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.910 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:08:37.911 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.912 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.913 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.914 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.915 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.916 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-09-21T07:08:37.917 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.918 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.919 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.920 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.921 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.922 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.923 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.924 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.925 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.926 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.927 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.928 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.929 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.930 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_keepalive_interval": { 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-09-21T07:08:37.931 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.932 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.933 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.934 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:08:37.935 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.936 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.937 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.939 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.940 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:08:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.942 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.943 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.944 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.945 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.946 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.947 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.948 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.949 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.950 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:08:37.951 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.952 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.953 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.954 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.955 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.956 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.957 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.958 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.959 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:08:37.960 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.961 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.962 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.963 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "[]", 2024-09-21T07:08:37.964 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "{}", 2024-09-21T07:08:37.965 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.966 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.968 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.969 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.970 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.971 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.972 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.973 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.974 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:08:37.975 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.976 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.977 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.978 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.979 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-09-21T07:08:37.980 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.981 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.982 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.983 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.984 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.985 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.986 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.987 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.989 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.990 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.991 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.992 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:37.993 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:37.994 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.995 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.996 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.997 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:37.998 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:37.999 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.000 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "sso_oauth2": { 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sso_oauth2", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.002 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.003 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-09-21T07:08:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.006 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.007 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.009 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.010 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.011 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.012 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.013 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-09-21T07:08:38.014 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:38.015 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.016 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.017 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-09-21T07:08:38.018 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.020 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.021 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.022 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-09-21T07:08:38.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.024 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.025 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.026 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.027 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-09-21T07:08:38.028 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-09-21T07:08:38.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.030 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.031 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.032 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.033 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.034 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-09-21T07:08:38.035 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.036 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.037 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.038 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:38.039 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:08:38.040 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.041 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.042 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.043 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.044 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.045 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.046 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-09-21T07:08:38.047 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.048 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.049 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.050 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.051 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.052 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.053 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:08:38.054 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.055 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.056 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.057 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.058 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.059 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.060 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.061 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.062 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.063 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.064 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.065 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.066 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.068 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-09-21T07:08:38.070 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.071 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.072 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.073 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.074 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.075 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.076 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.077 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.078 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.079 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.080 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.081 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.082 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.083 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.084 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.085 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.086 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.087 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.088 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.089 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.090 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.091 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.092 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.093 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.094 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.095 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.096 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.097 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.098 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.099 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.101 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.102 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.103 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.104 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.105 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.106 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.107 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.108 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.109 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.110 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.111 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.112 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.113 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:38.114 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.115 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:38.116 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.117 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.119 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.120 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.124 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.125 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:08:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.127 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.128 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.129 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.130 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.131 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.132 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.133 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.134 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.135 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.136 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.137 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-09-21T07:08:38.138 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-09-21T07:08:38.139 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.140 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.141 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.143 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.144 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.145 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.146 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.147 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.148 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.149 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.150 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.151 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.152 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.153 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.154 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.155 INFO:teuthology.orchestra.run.smithi028.stdout: "max_requests": { 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_requests", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-09-21T07:08:38.156 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-09-21T07:08:38.157 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.158 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.159 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.160 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.161 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.162 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.163 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.164 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.165 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.166 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.167 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.168 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.169 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.170 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.171 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.172 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.173 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.174 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.175 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.176 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.177 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.178 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.179 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.180 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.181 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.182 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-09-21T07:08:38.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.184 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.185 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.186 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.187 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.188 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.189 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smb", 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "internal_store_backend": { 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "internal_store_backend", 2024-09-21T07:08:38.190 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.192 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.194 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.195 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.196 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "update_orchestration": { 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "update_orchestration", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.197 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-09-21T07:08:38.198 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.199 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.201 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.202 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.203 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.204 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.205 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.206 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.207 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.208 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.210 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-09-21T07:08:38.211 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.212 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.213 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.214 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.215 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.216 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-09-21T07:08:38.217 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.218 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.219 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.220 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.221 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.222 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.223 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.224 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.225 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.226 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.227 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.234 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.235 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.236 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.237 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.238 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.239 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.240 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.241 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-09-21T07:08:38.242 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.243 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.244 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.245 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.246 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.247 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.248 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.249 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.250 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.251 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.252 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.253 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.254 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.255 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.256 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.257 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.258 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-09-21T07:08:38.259 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.260 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.261 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.262 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.263 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.264 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.265 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.266 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-09-21T07:08:38.267 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "sqlite3_killpoint": { 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "dev", 2024-09-21T07:08:38.268 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.269 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.270 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-09-21T07:08:38.271 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "services": { 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "dashboard": "https://172.21.15.28:8443/" 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "always_on_modules": { 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus": [ 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-09-21T07:08:38.272 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific": [ 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.273 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy": [ 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "reef": [ 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-09-21T07:08:38.274 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "squid": [ 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-09-21T07:08:38.275 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "last_failure_osd_epoch": 3, 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "active_clients": [ 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 718156485 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.276 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "libcephsqlite", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 3617854157 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-09-21T07:08:38.277 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 1276856171 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 1395330537 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-21T07:08:38.278 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:08:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 msgr2=0x7ff9140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 0x7ff9140b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff9180058c0 tx=0x7ff918005850 comp rx=0 tx=0).stop 2024-09-21T07:08:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 msgr2=0x7ff928198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d770 tx=0x7ff92400dc30 comp rx=0 tx=0).stop 2024-09-21T07:08:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 shutdown_connections 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff9140b6510 0x7ff9140b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff928103fc0 0x7ff92819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff928103620 0x7ff928199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 --2- 172.21.15.28:0/3230290577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9281025a0 0x7ff928198de0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 >> 172.21.15.28:0/3230290577 conn(0x7ff9280fdee0 msgr2=0x7ff928106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 shutdown_connections 2024-09-21T07:08:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:36.949+0000 7ff92f64d640 1 -- 172.21.15.28:0/3230290577 wait complete. 2024-09-21T07:08:38.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/1088480237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:38.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3786648798' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/240778971' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:36 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2530724330' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.288 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T07:08:38.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T07:08:38.288 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:37 smithi028 ceph-mon[31213]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T07:08:38.288 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:37 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3230290577' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:08:38.289 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:37 smithi129 ceph-mon[34863]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T07:08:38.289 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:37 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3230290577' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:08:38.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/1088480237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:38.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3786648798' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/240778971' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:36 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2530724330' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:08:38.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:37 smithi181 ceph-mon[34686]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T07:08:38.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:37 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3230290577' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:08:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 124, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 174, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 36863, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 73928, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 8, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:39.105 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.022782073, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.008884516, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.009974059, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.001972134, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 173, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.027426376, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000158533 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 241, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000066245, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000274 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.106 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 141, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 130, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 838232, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 107181, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 11, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 7, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.023901369, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.006943563, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.026876734, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000205729, 2024-09-21T07:08:39.107 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 129, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.021851184, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000169389 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 19, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000003244, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000170 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 834864, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 52224 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.108 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 15, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 68, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 3884, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 186123, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 7, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 5, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.010387610, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.005634657, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.003903610, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000265723, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 66, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.009215546, 2024-09-21T07:08:39.109 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000139629 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 7, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000001312, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000187 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 175200 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 1, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-MDSRank": { 2024-09-21T07:08:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 50, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.001334241, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000026684 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 2, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000015634, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000007817 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.111 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": { 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "request": 6, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "reply": 4, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "reply_latency": { 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 4, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.002577995, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000644498 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_reply": 0, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "forward": 2, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_commit": 11, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_split": 0, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_merge": 0, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes": 12, 2024-09-21T07:08:39.112 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_top": 0, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_bottom": 12, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pinned": 11, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_expired": 0, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_with_caps": 1, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": 1, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "subtrees": 2, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse": 8, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_hit": 6, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_forward": 0, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_discover": 2, 2024-09-21T07:08:39.113 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_lock": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "load_cent": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "q": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "exported": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "exported_inodes": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "imported": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "imported_inodes": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_peer_discover": 1, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rfiles": 8, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rbytes": 269505890, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rsnaps": 0, 2024-09-21T07:08:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps": 0, 2024-09-21T07:08:39.115 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_cap_release": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "process_request_cap_release": 0 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_cache": { 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_try_discover": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_send_discover": 3, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_handle_discover": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_created": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_enqueued": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:39.116 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_migrated": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_started": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_completed": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_flush": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "uninline_started": 0, 2024-09-21T07:08:39.117 INFO:teuthology.orchestra.run.smithi028.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "uninline_write_failed": 0 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_log": { 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evlrg": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evadd": 5, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evex": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evtrm": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "ev": 5, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evexg": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "evexd": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "segadd": 2, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "segex": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "segtrm": 0, 2024-09-21T07:08:39.118 INFO:teuthology.orchestra.run.smithi028.stdout: "seg": 2, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "segmjr": 2, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "segexg": 0, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "segexd": 0, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "expos": 4194304, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "wrpos": 4195732, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "rdpos": 0, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "jlat": { 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 4, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.007593684, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.001898421 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "replayed": 0 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_mem": { 2024-09-21T07:08:39.119 INFO:teuthology.orchestra.run.smithi028.stdout: "ino": 15, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "ino+": 15, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "ino-": 0, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dir": 13, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dir+": 14, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dir-": 1, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dn": 12, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dn+": 12, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "dn-": 0, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "cap": 1, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "cap+": 4, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "cap-": 3, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "rss": 119532, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "heap": 324804608 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.120 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_server": { 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_client_request": 11, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_server_request": 0, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_request": 6, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_session": 6, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_peer_request": 1, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "req_create_latency": { 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getattr_latency": { 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 1, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.001446272, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.001446272 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "req_link_latency": { 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookup_latency": { 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 2, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.001027531, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000513765 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:39.122 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupino_latency": { 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 1, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000104192, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000104192 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupname_latency": { 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lssnap_latency": { 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mkdir_latency": { 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mknod_latency": { 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.125 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mksnap_latency": { 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "req_open_latency": { 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "req_readdir_latency": { 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rename_latency": { 2024-09-21T07:08:39.126 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmdir_latency": { 2024-09-21T07:08:39.127 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setattr_latency": { 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.128 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setlayout_latency": { 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.129 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setxattr_latency": { 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "req_symlink_latency": { 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "req_unlink_latency": { 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.130 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_sessions": { 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "session_count": 1, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "session_add": 2, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "session_remove": 1, 2024-09-21T07:08:39.131 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_open": 1, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_stale": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "total_load": 3, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "average_load": 1, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "avg_session_uptime": 126, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:39.132 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:39.133 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 247327, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 87, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 88, 2024-09-21T07:08:39.134 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 1, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 154, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 60024, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 238, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:39.135 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "objecter": { 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_active": 0, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_laggy": 0, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send": 42, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send_bytes": 11955, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_resend": 33, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_reply": 42, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "op_latency": { 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 42, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.242993534, 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.005785560 2024-09-21T07:08:39.136 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op_inflight": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "oplen_avg": { 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 42, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 66 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op": 42, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op_r": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op_w": 42, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op_rmw": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "op_pg": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_stat": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_create": 10, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_read": 0, 2024-09-21T07:08:39.137 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_write": 4, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writefull": 7, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writesame": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_append": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_zero": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_truncate": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_delete": 6, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_mapext": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_getxattr": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_setxattr": 20, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_call": 0, 2024-09-21T07:08:39.138 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_watch": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_notify": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_other": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_active": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_send": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_resend": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_ping": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_active": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_send": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_resend": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_active": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_send": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_resend": 0, 2024-09-21T07:08:39.139 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_active": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_send": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_resend": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "command_active": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "command_send": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "command_resend": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "map_epoch": 74, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "map_full": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "map_inc": 2, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_sessions": 9, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_open": 9, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_close": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_laggy": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_wr": 17, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_rd": 0, 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_del": 2 2024-09-21T07:08:39.140 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "oft": { 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_objs": 1, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_updates": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_removes": 0 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "purge_queue": { 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_high_water": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed_ops": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed": 0, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.141 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 276, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 844898, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 276, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 276, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 844898, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.142 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 42, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 11955, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 42, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 11955, 2024-09-21T07:08:39.143 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 1024, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 42, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 42, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 42, 2024-09-21T07:08:39.144 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 42, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:39.145 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 0, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 0, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle-0x556ae3f89450": { 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 5, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 1428, 2024-09-21T07:08:39.146 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 5, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 4, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 1428, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "trackedop": { 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_ops_count": 0 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:39.147 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:08:39.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:39 smithi129 ceph-mon[34863]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 689 KiB/s wr, 7 op/s 2024-09-21T07:08:39.924 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:39 smithi028 ceph-mon[31213]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 689 KiB/s wr, 7 op/s 2024-09-21T07:08:39.960 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T07:08:39.960 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T07:08:39.960 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T07:08:39.960 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T07:08:40.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:39 smithi181 ceph-mon[34686]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 689 KiB/s wr, 7 op/s 2024-09-21T07:08:40.229 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 0, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 2, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 0, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:40.936 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.001316806, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.000246365, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:40.937 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 1, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 58, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 90448, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.006576159, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.004654259, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.001298850, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:40.938 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 56, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.002517744, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000044959 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 90448 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 86, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 79, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 800640, 2024-09-21T07:08:40.939 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 46720, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.019883452, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.006244194, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.020961146, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 79, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.008006186, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000101344 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:40.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 800640, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 46720 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:40.941 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:40.942 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 148863, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 28, 2024-09-21T07:08:40.943 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 2, 2024-09-21T07:08:40.944 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 83, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 786132, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 83, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:40.945 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 83, 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 786132, 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:40.946 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:08:41.622 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T07:08:41.622 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T07:08:41.622 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T07:08:41.622 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T07:08:41.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:41 smithi129 ceph-mon[34863]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-21T07:08:41.881 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:42.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:41 smithi028 ceph-mon[31213]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-21T07:08:42.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:41 smithi181 ceph-mon[34686]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-21T07:08:42.369 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 77, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 72, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 796224, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 43552, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.018704442, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.005915727, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.019131738, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:42.370 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 71, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.003804090, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000053578 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 796224, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 43552 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 1, 2024-09-21T07:08:42.371 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 55, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 89920, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.005879621, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.004123938, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.001163607, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 53, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.002420271, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000045665 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:42.372 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 89920 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 4, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 4, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 2992, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 448, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.002241241, 2024-09-21T07:08:42.373 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000052703, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.002230668, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 3, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.004053855, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.001351285 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:08:42.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:42.375 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:42.376 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 148779, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 27, 2024-09-21T07:08:42.377 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:42.378 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 2, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 78, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 785418, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 78, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:42.379 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 78, 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 785418, 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:42.380 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:08:43.124 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T07:08:43.125 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T07:08:43.125 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T07:08:43.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T07:08:43.388 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:43.772 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:43 smithi028 ceph-mon[31213]: pgmap v409: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-09-21T07:08:43.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:43 smithi129 ceph-mon[34863]: pgmap v409: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-09-21T07:08:43.895 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-21T07:08:43.895 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:43.895 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 4, 2024-09-21T07:08:43.895 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 4, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 2992, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 448, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.003359604, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000050220, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.002370510, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 3, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.004029393, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.001343131 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.896 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 1, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 59, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 90624, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.006226191, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.004364682, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.001264127, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 57, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.002317584, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000040659 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.898 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 90624 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 83, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 78, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 797920, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 46912, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.020820792, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.006926690, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.022102537, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 77, 2024-09-21T07:08:43.899 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.004428686, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000057515 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 797920, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 46912 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 0, 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-09-21T07:08:43.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:43.901 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:43.902 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 148823, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 27, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:43.903 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 2, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-21T07:08:43.904 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 84, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 786262, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 84, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 84, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 786262, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-09-21T07:08:43.905 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-09-21T07:08:43.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-09-21T07:08:43.906 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:43.906 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-21T07:08:43.906 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-21T07:08:44.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:43 smithi181 ceph-mon[34686]: pgmap v409: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-09-21T07:08:44.607 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T07:08:44.607 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T07:08:44.607 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T07:08:44.608 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T07:08:44.869 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 542, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 420, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 177009, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 749512, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 10, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.062907248, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.022940578, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.024956869, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.014379586, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 421, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.350352755, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000832191 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 330, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000079050, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000239 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 34208, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 1456 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 583, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 470, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 202594, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 362896, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 12, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 6, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.070369476, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.024065352, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.029876437, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.017003550, 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 469, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.223780906, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000477144 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 576, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000115956, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000201 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 57568, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 212464 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 480, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 439, 2024-09-21T07:08:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 947473, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 182333, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 10, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 7, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.057267541, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.023322853, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.040713230, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.005593228, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 435, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.746415261, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001715897 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 272, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000073195, 2024-09-21T07:08:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000269 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 839088, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 50176 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "cct": { 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "total_workers": 1, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "unhealthy_workers": 0 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "finisher-MDSRank": { 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "queue_len": 0, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "complete_latency": { 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 310, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.087906697, 2024-09-21T07:08:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000283569 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "queue_len": 0, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "complete_latency": { 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 19, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000598056, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000031476 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "mds": { 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "request": 55, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "reply": 55, 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "reply_latency": { 2024-09-21T07:08:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 55, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.066492870, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001208961 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "slow_reply": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "forward": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_commit": 12, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_split": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_merge": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes": 26, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_top": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_bottom": 26, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_pinned": 25, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_expired": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_with_caps": 3, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "caps": 3, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "subtrees": 2, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse": 70, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_hit": 63, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_forward": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_discover": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_lock": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "load_cent": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "q": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "exported": 0, 2024-09-21T07:08:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "exported_inodes": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "imported": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "imported_inodes": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_peer_discover": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rfiles": 4, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rbytes": 234, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rsnaps": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_inode_file_caps": 1, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_revoke": 16, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_grant": 32, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_caps": 100, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_caps_dirty": 79, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_cap_release": 2, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "process_request_cap_release": 26 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_cache": { 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_update": 0, 2024-09-21T07:08:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_try_discover": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_send_discover": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_handle_discover": 5, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays": 2, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_created": 6, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_enqueued": 4, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_migrated": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "recovery_started": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "recovery_completed": 0, 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_flush": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_started": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_write_failed": 0 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_log": { 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "evlrg": 0, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "evadd": 151, 2024-09-21T07:08:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "evex": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "evtrm": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "ev": 151, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "evexg": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "evexd": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segadd": 2, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segex": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segtrm": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "seg": 2, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segmjr": 2, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segexg": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "segexd": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "expos": 4194304, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "wrpos": 4804313, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "rdpos": 0, 2024-09-21T07:08:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "jlat": { 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 124, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.272090251, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.002194276 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "replayed": 0 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_mem": { 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "ino": 25, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "ino+": 29, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "ino-": 4, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "dir": 19, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "dir+": 20, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "dir-": 1, 2024-09-21T07:08:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "dn": 26, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "dn+": 35, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "dn-": 9, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "cap": 3, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "cap+": 20, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "cap-": 17, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "rss": 120808, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "heap": 335298560 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_server": { 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "dispatch_client_request": 75, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "dispatch_server_request": 1, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_request": 55, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_session": 13, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_peer_request": 2, 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "req_create_latency": { 2024-09-21T07:08:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 8, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.006237104, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000779638 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getattr_latency": { 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 16, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.003213031, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000200814 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "req_link_latency": { 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookup_latency": { 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupino_latency": { 2024-09-21T07:08:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 1, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000152299, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000152299 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupname_latency": { 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lssnap_latency": { 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mkdir_latency": { 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 8, 2024-09-21T07:08:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.013495852, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001686981 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mknod_latency": { 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mksnap_latency": { 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "req_open_latency": { 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 1, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000207525, 2024-09-21T07:08:45.609 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000207525 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "req_readdir_latency": { 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 2, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.001044480, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000522240 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rename_latency": { 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 2, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.002239135, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001119567 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmdir_latency": { 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 2, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.009639271, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.004819635 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.611 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setattr_latency": { 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 1, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.001160816, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001160816 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:45.612 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setlayout_latency": { 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setxattr_latency": { 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 10, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.023468320, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.002346832 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "req_symlink_latency": { 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.613 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "req_unlink_latency": { 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 4, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.005635037, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001408759 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_sessions": { 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "session_count": 1, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "session_add": 3, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "session_remove": 2, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions_open": 1, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions_stale": 0, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "total_load": 15, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "average_load": 15, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "avg_session_uptime": 135, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "mempool": { 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:45.615 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:45.616 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:45.617 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_bytes": 299352, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_items": 128, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_bytes": 616, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_items": 7, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_bytes": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_items": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_items": 154, 2024-09-21T07:08:45.618 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_items": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_bytes": 103228, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_items": 894, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_items": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_items": 0 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "objecter": { 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "op_active": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "op_laggy": 0, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "op_send": 704, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "op_send_bytes": 626088, 2024-09-21T07:08:45.619 INFO:teuthology.orchestra.run.smithi129.stdout: "op_resend": 37, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_reply": 704, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_latency": { 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 704, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 19.491572346, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.027686892 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_inflight": 0, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "oplen_avg": { 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 704, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 748 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op": 704, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_r": 1, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_w": 703, 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi129.stdout: "op_rmw": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "op_pg": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_stat": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_create": 11, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_read": 1, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_write": 125, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_writefull": 18, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_writesame": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_append": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_zero": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_truncate": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_delete": 516, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_mapext": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_getxattr": 0, 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_setxattr": 22, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_call": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_watch": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_notify": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_pgls": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_other": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_active": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_send": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_resend": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_ping": 0, 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_active": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_send": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_resend": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_active": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_send": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_resend": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_active": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_send": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_resend": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "command_active": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "command_send": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "command_resend": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "map_epoch": 74, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "map_full": 0, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "map_inc": 2, 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_sessions": 12, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_session_open": 12, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_session_close": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_laggy": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_wr": 45, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_rd": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_del": 10 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "oft": { 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_objs": 1, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_updates": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_removes": 0 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "purge_queue": { 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:45.624 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_ops_high_water": 4, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing": 0, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_high_water": 4, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executed_ops": 4, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executed": 4, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 1601, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 1164062, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 1601, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:45.625 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 1601, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 1164062, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:45.626 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 704, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 626492, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 704, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 626492, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 1024, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:45.627 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 704, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 704, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 704, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 704, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 3758096384, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:45.628 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 4, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 404, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 4, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 1, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 404, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-write_buf_throttle-0x561313d19520": { 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 3758096384, 2024-09-21T07:08:45.629 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 151, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 610009, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 151, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 124, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 610009, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:45.630 INFO:teuthology.orchestra.run.smithi129.stdout: "trackedop": { 2024-09-21T07:08:45.631 INFO:teuthology.orchestra.run.smithi129.stdout: "slow_ops_count": 0 2024-09-21T07:08:45.631 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:45.631 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T07:08:45.849 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:45 smithi129 ceph-mon[34863]: pgmap v410: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 12 op/s 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:45 smithi181 ceph-mon[34686]: pgmap v410: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 12 op/s 2024-09-21T07:08:46.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:45 smithi028 ceph-mon[31213]: pgmap v410: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 12 op/s 2024-09-21T07:08:46.532 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T07:08:46.532 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T07:08:46.532 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T07:08:46.532 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T07:08:46.786 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:08:47.354 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 0, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 2, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 0, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.001065348, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.000188382, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 5, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 61, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 3152, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 91072, 2024-09-21T07:08:47.356 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.007008455, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.003738810, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.002673269, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 60, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.006988019, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000116466 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 91072 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 83, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 78, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 797920, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 46912, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.020592953, 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.007154547, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.022710093, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 77, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.004568764, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000059334 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 797920, 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 46912 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "cct": { 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "total_workers": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "unhealthy_workers": 0 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "mempool": { 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:47.360 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:47.361 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_items": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_bytes": 148863, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_items": 28, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:47.362 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_items": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_items": 2, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:47.363 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_items": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_items": 0 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 84, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 786262, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 84, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:47.364 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 84, 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 786262, 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:47.365 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T07:08:47.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:47 smithi129 ceph-mon[34863]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:48.022 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:47 smithi181 ceph-mon[34686]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:48.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:47 smithi028 ceph-mon[31213]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T07:08:48.087 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-21T07:08:48.088 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-21T07:08:48.088 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T07:08:48.088 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T07:08:48.339 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 555, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 557, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 772494, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 176500, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 6, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.065320420, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.031466477, 2024-09-21T07:08:48.896 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.013498159, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.014936762, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 555, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.021636837, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000038985 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:48.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 95, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 88, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 821960, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 48314, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.020706346, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.007026189, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.021260046, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000099980, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 87, 2024-09-21T07:08:48.898 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.008776124, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000100874 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 820304, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 46976 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 235, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 289, 2024-09-21T07:08:48.899 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 59803, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 250965, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.031910669, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.013871519, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.007615335, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.008010446, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 288, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.014636737, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000050822 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:48.900 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 177824 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "cct": { 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "total_workers": 1, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "unhealthy_workers": 0 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "finisher-MDSRank": { 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "queue_len": 0, 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "complete_latency": { 2024-09-21T07:08:48.901 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 1338, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.036443059, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000027236 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "queue_len": 0, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "complete_latency": { 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "mds": { 2024-09-21T07:08:48.902 INFO:teuthology.orchestra.run.smithi129.stdout: "request": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "reply": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "reply_latency": { 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "slow_reply": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "forward": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_commit": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_split": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_merge": 0, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes": 21, 2024-09-21T07:08:48.903 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_top": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_bottom": 21, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_pinned": 21, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_expired": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "inodes_with_caps": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "caps": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "subtrees": 2, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_hit": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_forward": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_discover": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "traverse_lock": 0, 2024-09-21T07:08:48.904 INFO:teuthology.orchestra.run.smithi129.stdout: "load_cent": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "q": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "exported": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "exported_inodes": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "imported": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "imported_inodes": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "openino_peer_discover": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rfiles": 4, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rbytes": 234, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "root_rsnaps": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:48.905 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_caps": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_cap_release": 0, 2024-09-21T07:08:48.906 INFO:teuthology.orchestra.run.smithi129.stdout: "process_request_cap_release": 0 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_cache": { 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_update": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_try_discover": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_send_discover": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "dir_handle_discover": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_created": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_enqueued": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:48.907 INFO:teuthology.orchestra.run.smithi129.stdout: "strays_migrated": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "recovery_started": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "recovery_completed": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_flush": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:48.908 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_started": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "uninline_write_failed": 0 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_log": { 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evlrg": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evadd": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evex": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evtrm": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "ev": 151, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evexg": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "evexd": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "segadd": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "segex": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "segtrm": 0, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "seg": 2, 2024-09-21T07:08:48.909 INFO:teuthology.orchestra.run.smithi129.stdout: "segmjr": 2, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "segexg": 0, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "segexd": 0, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "expos": 4194304, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "wrpos": 4804313, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "rdpos": 4801990, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "jlat": { 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "replayed": 151 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.910 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_mem": { 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "ino": 16, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "ino+": 20, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "ino-": 4, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dir": 10, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dir+": 11, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dir-": 1, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dn": 21, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dn+": 25, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "dn-": 4, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "cap": 0, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "cap+": 0, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "cap-": 0, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "rss": 117356, 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: "heap": 316416000 2024-09-21T07:08:48.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_server": { 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "dispatch_client_request": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "dispatch_server_request": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_request": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_client_session": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "handle_peer_request": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "req_create_latency": { 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getattr_latency": { 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.912 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "req_link_latency": { 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookup_latency": { 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.913 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupino_latency": { 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupname_latency": { 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.914 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "req_lssnap_latency": { 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.915 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mkdir_latency": { 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mknod_latency": { 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "req_mksnap_latency": { 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "req_open_latency": { 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.917 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "req_readdir_latency": { 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rename_latency": { 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.918 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmdir_latency": { 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.919 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setattr_latency": { 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.920 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setlayout_latency": { 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "req_setxattr_latency": { 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "req_symlink_latency": { 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "req_unlink_latency": { 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.922 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_sessions": { 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "session_count": 1, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "session_add": 3, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "session_remove": 2, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions_open": 2, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions_stale": 0, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "total_load": 0, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "average_load": 0, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "avg_session_uptime": 2669, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.923 INFO:teuthology.orchestra.run.smithi129.stdout: "mempool": { 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:48.924 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:48.925 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_bytes": 189313, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_items": 50, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:48.926 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_items": 154, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_items": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_bytes": 64460, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_items": 539, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_items": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_items": 0 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "objecter": { 2024-09-21T07:08:48.927 INFO:teuthology.orchestra.run.smithi129.stdout: "op_active": 0, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_laggy": 0, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_send": 789, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_send_bytes": 26, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_resend": 4, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_reply": 789, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_latency": { 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 789, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.341992502, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000433450 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "op_inflight": 0, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "oplen_avg": { 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 789, 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 790 2024-09-21T07:08:48.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "op": 789, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "op_r": 789, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "op_w": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "op_rmw": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "op_pg": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_stat": 468, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_create": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_read": 318, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_write": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_writefull": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_writesame": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_append": 0, 2024-09-21T07:08:48.929 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_zero": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_truncate": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_delete": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_mapext": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_getxattr": 2, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_setxattr": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_call": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_watch": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_notify": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:48.930 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_pgls": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "osdop_other": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_active": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_send": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_resend": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "linger_ping": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_active": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_send": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolop_resend": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_active": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_send": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "poolstat_resend": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_active": 0, 2024-09-21T07:08:48.931 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_send": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "statfs_resend": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "command_active": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "command_send": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "command_resend": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "map_epoch": 74, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "map_full": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "map_inc": 2, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_sessions": 5, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_session_open": 5, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_session_close": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_laggy": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_wr": 0, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_rd": 2, 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_del": 0 2024-09-21T07:08:48.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "oft": { 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_objs": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_updates": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "omap_total_removes": 0 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "purge_queue": { 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executing_high_water": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executed_ops": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_executed": 0, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:48.933 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 881, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 1567343, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 881, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 881, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 1567343, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.934 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 789, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 610019, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 789, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 610019, 2024-09-21T07:08:48.935 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 1024, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 789, 2024-09-21T07:08:48.936 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 789, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 789, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 789, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 3758096384, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:48.937 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-write_buf_throttle-0x560cbf51d5f0": { 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:48.938 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 3758096384, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:48.940 INFO:teuthology.orchestra.run.smithi129.stdout: "trackedop": { 2024-09-21T07:08:48.940 INFO:teuthology.orchestra.run.smithi129.stdout: "slow_ops_count": 0 2024-09-21T07:08:48.940 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:48.940 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T07:08:49.719 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T07:08:49.720 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T07:08:49.720 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T07:08:49.720 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T07:08:49.857 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:49 smithi129 ceph-mon[34863]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 17 MiB/s wr, 11 op/s 2024-09-21T07:08:49.968 INFO:teuthology.orchestra.run.smithi129.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:08:50.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:49 smithi181 ceph-mon[34686]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 17 MiB/s wr, 11 op/s 2024-09-21T07:08:50.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:49 smithi028 ceph-mon[31213]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 17 MiB/s wr, 11 op/s 2024-09-21T07:08:50.465 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 4, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 4, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 2992, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 448, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.002857578, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.000038544, 2024-09-21T07:08:50.466 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.002086789, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 3, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.003885808, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.001295269 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.467 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 1, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 61, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 90976, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.006199674, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.004156272, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.001258603, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 59, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.003797398, 2024-09-21T07:08:50.468 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000064362 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 90976 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_messages": 86, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages": 81, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_bytes": 798736, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_bytes": 48832, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:50.469 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_total_time": 0.020783659, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_send_time": 0.007198720, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_recv_time": 0.022968002, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 80, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.005603152, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000070039 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_recv_encrypted_bytes": 798736, 2024-09-21T07:08:50.470 INFO:teuthology.orchestra.run.smithi129.stdout: "msgr_send_encrypted_bytes": 48832 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "cct": { 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "total_workers": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "unhealthy_workers": 0 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "mempool": { 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:50.471 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:50.472 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:50.473 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_items": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_bytes": 148823, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_anon_items": 27, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_bytes": 0, 2024-09-21T07:08:50.474 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "pgmap_items": 0, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_co_items": 2, 2024-09-21T07:08:50.475 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_1_items": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "unittest_2_items": 0 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "val": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "max": 104857600, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "get_started": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "get": 87, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "get_sum": 786652, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "get_or_fail_success": 87, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "take": 0, 2024-09-21T07:08:50.476 INFO:teuthology.orchestra.run.smithi129.stdout: "take_sum": 0, 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "put": 87, 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "put_sum": 786652, 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "wait": { 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "avgcount": 0, 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "sum": 0.000000000, 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: "avgtime": 0.000000000 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-21T07:08:50.477 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-21T07:08:51.195 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T07:08:51.195 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T07:08:51.195 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T07:08:51.195 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T07:08:51.455 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:51 smithi129 ceph-mon[34863]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-21T07:08:51.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:51 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:51.876 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:51 smithi181 ceph-mon[34686]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-21T07:08:51.876 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:51 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:52.001 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 634, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 634, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 185675, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 200795, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.076158615, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.032953678, 2024-09-21T07:08:52.002 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.017989124, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.019620907, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 633, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.031681373, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000050049 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:08:52.003 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 94, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 87, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 821244, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 48794, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.021730602, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007264157, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.024118956, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000064674, 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 86, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.007179845, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000083486 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 820688, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 48096 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 2, 2024-09-21T07:08:52.005 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 60, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 428, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 181326, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.005638970, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.003394629, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.001574148, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000027168, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 58, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.004225013, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000072845 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:52.006 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181008 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:52.007 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1118, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.033510227, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000029973 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.008 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-21T07:08:52.009 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T07:08:52.010 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T07:08:52.011 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:08:52.012 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:52.013 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T07:08:52.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 5, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T07:08:52.015 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195732, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4195591, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 5 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-09-21T07:08:52.016 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 116652, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 316416000 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-21T07:08:52.017 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:52.020 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.021 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.022 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:52.023 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.024 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.025 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.026 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.027 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 2, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 2686, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:52.028 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:52.029 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:52.030 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 181193, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 46, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:52.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 154, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8672, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T07:08:52.032 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 633, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 633, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 633, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.348993080, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000551331 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 633, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 634 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.033 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 633, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 633, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 383, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 248, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T07:08:52.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T07:08:52.035 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T07:08:52.036 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 74, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 4, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 4, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T07:08:52.037 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:52.038 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 726, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 934325, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 726, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 726, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 934325, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.039 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 633, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1433, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 633, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1433, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 633, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 633, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 633, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 633, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.041 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:52.042 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55feb97f45b0": { 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:52.043 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:52.044 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T07:08:52.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:51 smithi028 ceph-mon[31213]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-21T07:08:52.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:51 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:52.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:52.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:52.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:52 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:08:52.855 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T07:08:52.855 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T07:08:52.855 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T07:08:52.856 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T07:08:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:52.856 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:52 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:08:53.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:53.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:53.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:52 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' 2024-09-21T07:08:53.112 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:53.639 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T07:08:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 94, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 87, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 821794, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 49060, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.022423691, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007688334, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.023025480, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000022405, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 86, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.006634647, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000077147 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 820960, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 48736 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 150, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 206, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 38844, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 225939, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-21T07:08:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.025005075, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.010600614, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.007011876, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.005488825, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 205, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.014337256, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000069937 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 179824 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 490, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 492, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 147293, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 155878, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.062335996, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.027660513, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.013687675, 2024-09-21T07:08:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.016148706, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 490, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.022309021, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045528 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T07:08:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1099, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.035080568, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000031920 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T07:08:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T07:08:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T07:08:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3, 2024-09-21T07:08:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195200, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4194892, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 3 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-09-21T07:08:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 116504, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 315375616 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.655 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.656 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T07:08:53.657 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.658 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.659 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.660 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T07:08:53.661 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T07:08:53.662 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.663 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.664 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.665 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 1, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 0, 2024-09-21T07:08:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1415, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 189239, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 48, 2024-09-21T07:08:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 154, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T07:08:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8672, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 636, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 636, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 636, 2024-09-21T07:08:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.333993378, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000525146 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 636, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 637 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 636, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 636, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 386, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-21T07:08:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 248, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T07:08:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 74, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 5, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 5, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-21T07:08:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 730, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 934497, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 730, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 730, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 934497, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 636, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 901, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 636, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 901, 2024-09-21T07:08:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 636, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 636, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 636, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 636, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55bf55e796c0": { 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:53.683 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T07:08:54.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:53 smithi181 ceph-mon[34686]: pgmap v414: 97 pgs: 97 active+clean; 201 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-21T07:08:54.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:53 smithi028 ceph-mon[31213]: pgmap v414: 97 pgs: 97 active+clean; 201 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-21T07:08:54.313 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T07:08:54.313 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T07:08:54.313 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T07:08:54.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T07:08:54.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:53 smithi129 ceph-mon[34863]: pgmap v414: 97 pgs: 97 active+clean; 201 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-21T07:08:54.562 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 151, 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 181, 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 44319, 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 69760, 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 8, 2024-09-21T07:08:55.111 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.024543346, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.010911710, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.010108809, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.002007132, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 181, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.028685888, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000158485 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 291, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000108397, 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000372 2024-09-21T07:08:55.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 137, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 128, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 834758, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 65645, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-21T07:08:55.113 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.023385301, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.008447934, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.021546895, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000476007, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 127, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.020757938, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000163448 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 830384, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 52416 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 19, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 77, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 6481, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 235429, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 7, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.011580887, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.004289769, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.006312329, 2024-09-21T07:08:55.115 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000238561, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 74, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.012925918, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000174674 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 13, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000002020, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000155 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181296 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T07:08:55.116 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 26, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.002392444, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000092017 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-21T07:08:55.117 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000025071, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000012535 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 2, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 1, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001013472, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001013472 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T07:08:55.118 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 1, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 14, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 14, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 14, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 1, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 1, 2024-09-21T07:08:55.119 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 2, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 3, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 1, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 1, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T07:08:55.120 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 8, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 269505890, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:08:55.121 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 1, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 1, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 1, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 1 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T07:08:55.122 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 2, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:08:55.123 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 3, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3, 2024-09-21T07:08:55.124 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 2, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195200, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.003648112, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001824056 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 17, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 17, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 15, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 16, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 1, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 14, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 14, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 1, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 1, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 116764, 2024-09-21T07:08:55.126 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 324808704 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 3, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 2, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 2, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T07:08:55.127 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001013472, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001013472 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T07:08:55.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T07:08:55.132 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T07:08:55.133 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.134 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 1, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 0, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 1, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 1, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 141, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:55.138 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:55.139 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:55.140 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 238351, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 74, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7496, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 154, 2024-09-21T07:08:55.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 68593, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 318, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T07:08:55.142 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 39, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 11513, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 29, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 39, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 39, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.234995332, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.006025521 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 39, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 63 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 39, 2024-09-21T07:08:55.143 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 39, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 2, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 6, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 6, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T07:08:55.144 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T07:08:55.145 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 74, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T07:08:55.146 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 8, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 8, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 18, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 1 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.147 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 303, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 849262, 2024-09-21T07:08:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 303, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 303, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 849262, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:55.149 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 39, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 11513, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 39, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 11513, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:55.150 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 39, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 39, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 39, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 39, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.151 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x560ba9c2d5f0": { 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 3, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 896, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 3, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 896, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:55.153 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:55.154 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T07:08:55.914 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T07:08:55.915 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T07:08:55.915 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T07:08:55.915 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T07:08:56.162 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:56.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:55 smithi181 ceph-mon[34686]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 19 MiB/s wr, 17 op/s 2024-09-21T07:08:56.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:55 smithi028 ceph-mon[31213]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 19 MiB/s wr, 17 op/s 2024-09-21T07:08:56.353 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:55 smithi129 ceph-mon[34863]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 19 MiB/s wr, 17 op/s 2024-09-21T07:08:56.694 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 0, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 0, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.001116592, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000308374, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:56.695 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.696 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 93, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 86, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 802608, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 50720, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.024250415, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.008198355, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.024722534, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 86, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.008948204, 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000104048 2024-09-21T07:08:56.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 802608, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 50720 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 63, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 91328, 2024-09-21T07:08:56.698 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 3, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.005904648, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.004277992, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000786820, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 61, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.004449509, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000072942 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:08:56.699 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 91328 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T07:08:56.700 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:08:56.701 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:08:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148841, 2024-09-21T07:08:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 28, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:08:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 968, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T07:08:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 90, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 787106, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 90, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 90, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 787106, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T07:08:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T07:08:56.707 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T07:08:57.546 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T07:08:57.547 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T07:08:57.547 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T07:08:57.563 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T07:08:57.563 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T07:08:57.563 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:08:57.584 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-21T07:08:57.584 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:08:57.644 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:08:57.955 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:58.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:57 smithi028 ceph-mon[31213]: pgmap v416: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-21T07:08:58.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:57 smithi181 ceph-mon[34686]: pgmap v416: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-21T07:08:58.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:57 smithi129 ceph-mon[34863]: pgmap v416: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 -- 172.21.15.28:0/2604765619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f0109df0 msgr2=0x7f47f0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 --2- 172.21.15.28:0/2604765619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f0109df0 0x7f47f0110620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009ca0 tx=0x7f47e802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 -- 172.21.15.28:0/2604765619 shutdown_connections 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 --2- 172.21.15.28:0/2604765619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f0109df0 0x7f47f0110620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 --2- 172.21.15.28:0/2604765619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f01094a0 0x7f47f01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 --2- 172.21.15.28:0/2604765619 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 0x7f47f0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 -- 172.21.15.28:0/2604765619 >> 172.21.15.28:0/2604765619 conn(0x7f47f007b850 msgr2=0x7f47f007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 -- 172.21.15.28:0/2604765619 shutdown_connections 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 -- 172.21.15.28:0/2604765619 wait complete. 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.432+0000 7f47f55ce640 1 Processor -- start 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 -- start start 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 0x7f47f019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f0109df0 0x7f47f019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0113b00 con 0x7f47f01094a0 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0113980 con 0x7f47f0103b60 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47f55ce640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0113c80 con 0x7f47f0109df0 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35182/0 (socket says 172.21.15.28:35182) 2024-09-21T07:08:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 -- 172.21.15.28:0/544190035 learned_addr learned my addr 172.21.15.28:0/544190035 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47eeffd640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 0x7f47f019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47ef7fe640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f0109df0 0x7f47f019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 -- 172.21.15.28:0/544190035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f0109df0 msgr2=0x7f47f019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f0109df0 0x7f47f019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 -- 172.21.15.28:0/544190035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 msgr2=0x7f47f019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 0x7f47f019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 -- 172.21.15.28:0/544190035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f01a03e0 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.433+0000 7f47e7fff640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d750 tx=0x7f47d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.434+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8017070 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.434+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47d80054d0 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.434+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f01a06d0 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.434+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004c30 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.434+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f01a6e30 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.435+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0103f70 con 0x7f47f01094a0 2024-09-21T07:08:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.438+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f47d8004dd0 con 0x7f47f01094a0 2024-09-21T07:08:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.439+0000 7f47ecff9640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 0x7f47dc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.439+0000 7f47eeffd640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 0x7f47dc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.439+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f47d80e6f90 con 0x7f47f01094a0 2024-09-21T07:08:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.439+0000 7f47eeffd640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 0x7f47dc0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009bd0 tx=0x7f47e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.442+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47d80b1c90 con 0x7f47f01094a0 2024-09-21T07:08:58.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.645+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47f019b5a0 con 0x7f47f01094a0 2024-09-21T07:08:58.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.645+0000 7f47ecff9640 1 -- 172.21.15.28:0/544190035 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v74) ==== 81+0+587 (secure 0 0 0) 0x7f47f019b5a0 con 0x7f47f01094a0 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/2008308045 2024-09-22T06:57:12.164877+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/1068367434 2024-09-22T06:57:12.164877+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6801/17761675 2024-09-22T06:57:12.164877+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/2395738640 2024-09-22T06:57:12.164877+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/1550047956 2024-09-22T06:56:45.859801+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/454902326 2024-09-22T06:56:45.859801+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6800/17761675 2024-09-22T06:57:12.164877+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/3368385201 2024-09-22T06:56:45.859801+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6801/4061456910 2024-09-22T06:56:45.859801+0000 2024-09-21T07:08:58.648 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6800/4061456910 2024-09-22T06:56:45.859801+0000 2024-09-21T07:08:58.649 INFO:teuthology.orchestra.run.smithi028.stderr:listed 10 entries 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 msgr2=0x7f47dc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 0x7f47dc0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009bd0 tx=0x7f47e0005f90 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 msgr2=0x7f47f019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d750 tx=0x7f47d800dc10 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 shutdown_connections 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f47dc0b6590 0x7f47dc0b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47f0109df0 0x7f47f019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47f01094a0 0x7f47f019aa10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 --2- 172.21.15.28:0/544190035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47f0103b60 0x7f47f019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.647+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 >> 172.21.15.28:0/544190035 conn(0x7f47f007b850 msgr2=0x7f47f0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:58.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.648+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 shutdown_connections 2024-09-21T07:08:58.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:08:58.648+0000 7f47f55ce640 1 -- 172.21.15.28:0/544190035 wait complete. 2024-09-21T07:08:59.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:58 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/544190035' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:08:59.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:58 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/544190035' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:08:59.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:58 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/544190035' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:08:59.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:08:59.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:08:59.469 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:08:59.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T07:08:59.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:08:59.517 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:08:59.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:08:59.550 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-21T07:08:59.606 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:08:59.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:08:59.607 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:08:59.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:08:59.675 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-09-21T07:08:59.774 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T07:08:59.784 INFO:tasks.cephadm:Teardown begin 2024-09-21T07:08:59.785 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:08:59.785 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:09:00.045 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:00.047 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:08:59 smithi028 ceph-mon[31213]: pgmap v417: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-09-21T07:09:00.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:08:59 smithi181 ceph-mon[34686]: pgmap v417: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-09-21T07:09:00.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:08:59 smithi129 ceph-mon[34863]: pgmap v417: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 -- 172.21.15.28:0/3068730056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 msgr2=0x7fb12410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 --2- 172.21.15.28:0/3068730056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12410fc00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009900 tx=0x7fb10c02a410 comp rx=0 tx=0).stop 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 -- 172.21.15.28:0/3068730056 shutdown_connections 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 --2- 172.21.15.28:0/3068730056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124110140 0x7fb124112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 --2- 172.21.15.28:0/3068730056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12410fc00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 --2- 172.21.15.28:0/3068730056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124075730 0x7fb124075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 -- 172.21.15.28:0/3068730056 >> 172.21.15.28:0/3068730056 conn(0x7fb12407b850 msgr2=0x7fb12407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 -- 172.21.15.28:0/3068730056 shutdown_connections 2024-09-21T07:09:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.524+0000 7fb12895d640 1 -- 172.21.15.28:0/3068730056 wait complete. 2024-09-21T07:09:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.525+0000 7fb12895d640 1 Processor -- start 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.525+0000 7fb12895d640 1 -- start start 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.525+0000 7fb12895d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124075730 0x7fb12419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.525+0000 7fb12895d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb12895d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124110140 0x7fb1241a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb12895d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb124115c80 con 0x7fb124076080 2024-09-21T07:09:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb12895d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb124115b00 con 0x7fb124075730 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb12895d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb124115e00 con 0x7fb124110140 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35190/0 (socket says 172.21.15.28:35190) 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 -- 172.21.15.28:0/2490716878 learned_addr learned my addr 172.21.15.28:0/2490716878 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb122d9d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124110140 0x7fb1241a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb12259c640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124075730 0x7fb12419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 -- 172.21.15.28:0/2490716878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124110140 msgr2=0x7fb1241a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124110140 0x7fb1241a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 -- 172.21.15.28:0/2490716878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124075730 msgr2=0x7fb12419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124075730 0x7fb12419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 -- 172.21.15.28:0/2490716878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1241a2600 con 0x7fb124076080 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb119d9b640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb10c02a930 tx=0x7fb10c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.526+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c03f030 con 0x7fb124076080 2024-09-21T07:09:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.527+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb10c003aa0 con 0x7fb124076080 2024-09-21T07:09:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.527+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1241a2890 con 0x7fb124076080 2024-09-21T07:09:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.527+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c035070 con 0x7fb124076080 2024-09-21T07:09:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.527+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1241a9050 con 0x7fb124076080 2024-09-21T07:09:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.528+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb124076c40 con 0x7fb124076080 2024-09-21T07:09:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.529+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb10c042030 con 0x7fb124076080 2024-09-21T07:09:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.530+0000 7fb11bfff640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 0x7fb1100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.530+0000 7fb12259c640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 0x7fb1100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.530+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb10c107cd0 con 0x7fb124076080 2024-09-21T07:09:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.531+0000 7fb12259c640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 0x7fb1100b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb1140058c0 tx=0x7fb11400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:00.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.533+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb10c0d2950 con 0x7fb124076080 2024-09-21T07:09:00.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.759+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb12410b2c0 con 0x7fb124076080 2024-09-21T07:09:00.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.760+0000 7fb11bfff640 1 -- 172.21.15.28:0/2490716878 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11913 (secure 0 0 0) 0x7fb10c0d7890 con 0x7fb124076080 2024-09-21T07:09:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:09:00.763 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":25,"btime":"2024-09-21T07:06:30:555436+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:06:30.346913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24623,24616]},"id":1}]} 2024-09-21T07:09:00.763 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 25 2024-09-21T07:09:00.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 msgr2=0x7fb1100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 0x7fb1100b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb1140058c0 tx=0x7fb11400a250 comp rx=0 tx=0).stop 2024-09-21T07:09:00.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 msgr2=0x7fb12419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb10c02a930 tx=0x7fb10c004270 comp rx=0 tx=0).stop 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 shutdown_connections 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fb1100b6510 0x7fb1100b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb124110140 0x7fb1241a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb124076080 0x7fb12419cc30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 --2- 172.21.15.28:0/2490716878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb124075730 0x7fb12419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 >> 172.21.15.28:0/2490716878 conn(0x7fb12407b850 msgr2=0x7fb124101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 shutdown_connections 2024-09-21T07:09:00.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:00.763+0000 7fb12895d640 1 -- 172.21.15.28:0/2490716878 wait complete. 2024-09-21T07:09:01.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:00 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2490716878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:01.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:00 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2490716878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:01.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:00 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2490716878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:01.527 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:09:01.789 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:02.175 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:01 smithi028 ceph-mon[31213]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-09-21T07:09:02.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:01 smithi181 ceph-mon[34686]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 -- 172.21.15.28:0/982142005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 msgr2=0x7f7c30103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/982142005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c30103f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009900 tx=0x7f7c2002a410 comp rx=0 tx=0).stop 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 -- 172.21.15.28:0/982142005 shutdown_connections 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/982142005 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c30110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/982142005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 0x7f7c301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/982142005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c30103f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 -- 172.21.15.28:0/982142005 >> 172.21.15.28:0/982142005 conn(0x7f7c3007b850 msgr2=0x7f7c3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 -- 172.21.15.28:0/982142005 shutdown_connections 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.264+0000 7f7c34b3b640 1 -- 172.21.15.28:0/982142005 wait complete. 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.265+0000 7f7c34b3b640 1 Processor -- start 2024-09-21T07:09:02.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.265+0000 7f7c34b3b640 1 -- start start 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 0x7f7c3019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c301a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30113ab0 con 0x7f7c30103b60 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30113930 con 0x7f7c30109df0 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c34b3b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30113c30 con 0x7f7c301094a0 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35218/0 (socket says 172.21.15.28:35218) 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 -- 172.21.15.28:0/2805540821 learned_addr learned my addr 172.21.15.28:0/2805540821 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2dd9b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 0x7f7c3019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2ed9d640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c301a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 -- 172.21.15.28:0/2805540821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 msgr2=0x7f7c3019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 0x7f7c3019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 -- 172.21.15.28:0/2805540821 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 msgr2=0x7f7c301a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c301a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 -- 172.21.15.28:0/2805540821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c301a2550 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2ed9d640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c301a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c2e59c640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7c20005940 tx=0x7f7c200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.266+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2003f030 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.267+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c20003cb0 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.267+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c301a27e0 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.267+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20035070 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.267+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c301a2cc0 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.268+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30103f70 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.269+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7c20042030 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.270+0000 7f7c1f7fe640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 0x7f7c180b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.270+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7c20107ba0 con 0x7f7c30103b60 2024-09-21T07:09:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.270+0000 7f7c2dd9b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 0x7f7c180b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.271+0000 7f7c2dd9b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 0x7f7c180b8a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c24007350 tx=0x7f7c240072e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.273+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c200ce440 con 0x7f7c30103b60 2024-09-21T07:09:02.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:01 smithi129 ceph-mon[34863]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-09-21T07:09:02.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.499+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c301a91e0 con 0x7f7c30103b60 2024-09-21T07:09:02.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.500+0000 7f7c1f7fe640 1 -- 172.21.15.28:0/2805540821 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11913 (secure 0 0 0) 0x7f7c200d2820 con 0x7f7c30103b60 2024-09-21T07:09:02.502 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:09:02.502 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":25,"btime":"2024-09-21T07:06:30:555436+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2354310763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2354310763},{"type":"v1","addr":"172.21.15.28:6835","nonce":2354310763}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2155481344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2155481344},{"type":"v1","addr":"172.21.15.28:6837","nonce":2155481344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/4017087846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":4017087846},{"type":"v1","addr":"172.21.15.28:6839","nonce":4017087846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24542,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6833/4256209134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":4256209134},{"type":"v1","addr":"172.21.15.129:6833","nonce":4256209134}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2982677704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2982677704},{"type":"v1","addr":"172.21.15.181:6833","nonce":2982677704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24569,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3637531952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6834","nonce":3637531952},{"type":"v1","addr":"172.21.15.129:6835","nonce":3637531952}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:04:40.762217+0000","modified":"2024-09-21T07:06:30.346913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24635,"mds_1":24623,"mds_2":24616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1882677876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1882677876},{"type":"v1","addr":"172.21.15.181:6835","nonce":1882677876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/499879490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":499879490},{"type":"v1","addr":"172.21.15.181:6837","nonce":499879490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.129:6837/2275077942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6836","nonce":2275077942},{"type":"v1","addr":"172.21.15.129:6837","nonce":2275077942}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/76790251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":76790251},{"type":"v1","addr":"172.21.15.181:6839","nonce":76790251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.28:6841/1067476795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":1067476795},{"type":"v1","addr":"172.21.15.28:6841","nonce":1067476795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6839/903226333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6838","nonce":903226333},{"type":"v1","addr":"172.21.15.129:6839","nonce":903226333}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24623,24616]},"id":1}]} 2024-09-21T07:09:02.502 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 25 2024-09-21T07:09:02.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 msgr2=0x7f7c180b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 0x7f7c180b8a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c24007350 tx=0x7f7c240072e0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 msgr2=0x7f7c3019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7c20005940 tx=0x7f7c200042f0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 shutdown_connections 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7f7c180b6540 0x7f7c180b8a50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c30109df0 0x7f7c301a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7c301094a0 0x7f7c3019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 --2- 172.21.15.28:0/2805540821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c30103b60 0x7f7c3019c6a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 >> 172.21.15.28:0/2805540821 conn(0x7f7c3007b850 msgr2=0x7f7c301072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 shutdown_connections 2024-09-21T07:09:02.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:02.502+0000 7f7c34b3b640 1 -- 172.21.15.28:0/2805540821 wait complete. 2024-09-21T07:09:03.223 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:02 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2805540821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.255 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:09:03.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:02 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2805540821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:02 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2805540821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.515 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 -- 172.21.15.28:0/2912404984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef101083a0 msgr2=0x7fef101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 --2- 172.21.15.28:0/2912404984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef101083a0 0x7fef101087b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7feef8009900 tx=0x7feef802a410 comp rx=0 tx=0).stop 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 -- 172.21.15.28:0/2912404984 shutdown_connections 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 --2- 172.21.15.28:0/2912404984 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef10108cf0 0x7fef1010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 --2- 172.21.15.28:0/2912404984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef101083a0 0x7fef101087b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 --2- 172.21.15.28:0/2912404984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10102a60 0x7fef10102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 -- 172.21.15.28:0/2912404984 >> 172.21.15.28:0/2912404984 conn(0x7fef10079730 msgr2=0x7fef10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:04.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 -- 172.21.15.28:0/2912404984 shutdown_connections 2024-09-21T07:09:04.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.020+0000 7fef1666f640 1 -- 172.21.15.28:0/2912404984 wait complete. 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.021+0000 7fef1666f640 1 Processor -- start 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.021+0000 7fef1666f640 1 -- start start 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef101083a0 0x7fef1010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10108cf0 0x7fef101104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:04.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef10113a80 con 0x7fef10102a60 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fef10113900 con 0x7fef101083a0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef1666f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef10113c00 con 0x7fef10108cf0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49306/0 (socket says 172.21.15.28:49306) 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 -- 172.21.15.28:0/3692095807 learned_addr learned my addr 172.21.15.28:0/3692095807 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef07fff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef101083a0 0x7fef1010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef14c0c640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10108cf0 0x7fef101104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 -- 172.21.15.28:0/3692095807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10108cf0 msgr2=0x7fef101104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10108cf0 0x7fef101104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 -- 172.21.15.28:0/3692095807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef101083a0 msgr2=0x7fef1010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef101083a0 0x7fef1010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 -- 172.21.15.28:0/3692095807 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef10110c80 con 0x7fef10102a60 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.022+0000 7fef0ffff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef0000d950 tx=0x7fef0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:04.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.023+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00017070 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.023+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef00009c30 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.023+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef101ace10 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.023+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0000f620 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.023+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef101ad270 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.024+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef10102e70 con 0x7fef10102a60 2024-09-21T07:09:04.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.025+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fef00005030 con 0x7fef10102a60 2024-09-21T07:09:04.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.026+0000 7fef0dffb640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 0x7feefc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:04.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.026+0000 7fef07fff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 0x7feefc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:04.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.026+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef000e6df0 con 0x7fef10102a60 2024-09-21T07:09:04.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.027+0000 7fef07fff640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 0x7feefc0b8aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feef8000c00 tx=0x7feef8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:04.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.029+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef00009de0 con 0x7fef10102a60 2024-09-21T07:09:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.222+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef1002e640 con 0x7fef10102a60 2024-09-21T07:09:04.224 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:03 smithi028 ceph-mon[31213]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T07:09:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.223+0000 7fef0dffb640 1 -- 172.21.15.28:0/3692095807 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22733 (secure 0 0 0) 0x7fef000b1a90 con 0x7fef10102a60 2024-09-21T07:09:04.226 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-21T07:09:04.226 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":74,"fsid":"7b450f7c-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:56:23.464820+0000","modified":"2024-09-21T07:05:13.840205+0000","last_up_change":"2024-09-21T07:03:49.014693+0000","last_in_change":"2024-09-21T07:03:25.353124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:59:58.659335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:04:36.287210+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:04:38.714984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f58e89f6-8401-4336-a335-96041060dc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6803","nonce":394219256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6805","nonce":394219256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6809","nonce":394219256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":394219256},{"type":"v1","addr":"172.21.15.28:6807","nonce":394219256}]},"public_addr":"172.21.15.28:6803/394219256","cluster_addr":"172.21.15.28:6805/394219256","heartbeat_back_addr":"172.21.15.28:6809/394219256","heartbeat_front_addr":"172.21.15.28:6807/394219256","state":["exists","up"]},{"osd":1,"uuid":"bac69547-8286-49a6-8ed8-bac8cf91e592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6801","nonce":1501531235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6803","nonce":1501531235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6807","nonce":1501531235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1501531235},{"type":"v1","addr":"172.21.15.129:6805","nonce":1501531235}]},"public_addr":"172.21.15.129:6801/1501531235","cluster_addr":"172.21.15.129:6803/1501531235","heartbeat_back_addr":"172.21.15.129:6807/1501531235","heartbeat_front_addr":"172.21.15.129:6805/1501531235","state":["exists","up"]},{"osd":2,"uuid":"6691236c-3f1e-4af1-bb2d-e8f46ac32640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6801","nonce":1137940490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6803","nonce":1137940490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6807","nonce":1137940490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1137940490},{"type":"v1","addr":"172.21.15.181:6805","nonce":1137940490}]},"public_addr":"172.21.15.181:6801/1137940490","cluster_addr":"172.21.15.181:6803/1137940490","heartbeat_back_addr":"172.21.15.181:6807/1137940490","heartbeat_front_addr":"172.21.15.181:6805/1137940490","state":["exists","up"]},{"osd":3,"uuid":"9b22145b-f0e6-4fa1-ae2c-91614505ef38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6811","nonce":1190124716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6813","nonce":1190124716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6817","nonce":1190124716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":1190124716},{"type":"v1","addr":"172.21.15.28:6815","nonce":1190124716}]},"public_addr":"172.21.15.28:6811/1190124716","cluster_addr":"172.21.15.28:6813/1190124716","heartbeat_back_addr":"172.21.15.28:6817/1190124716","heartbeat_front_addr":"172.21.15.28:6815/1190124716","state":["exists","up"]},{"osd":4,"uuid":"efcbe4ce-405f-4668-8538-6547a3121baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6809","nonce":3815377982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6811","nonce":3815377982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6815","nonce":3815377982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":3815377982},{"type":"v1","addr":"172.21.15.129:6813","nonce":3815377982}]},"public_addr":"172.21.15.129:6809/3815377982","cluster_addr":"172.21.15.129:6811/3815377982","heartbeat_back_addr":"172.21.15.129:6815/3815377982","heartbeat_front_addr":"172.21.15.129:6813/3815377982","state":["exists","up"]},{"osd":5,"uuid":"23b58876-da54-434b-b8aa-ce70f8edbb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6809","nonce":2730863123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6811","nonce":2730863123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6815","nonce":2730863123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2730863123},{"type":"v1","addr":"172.21.15.181:6813","nonce":2730863123}]},"public_addr":"172.21.15.181:6809/2730863123","cluster_addr":"172.21.15.181:6811/2730863123","heartbeat_back_addr":"172.21.15.181:6815/2730863123","heartbeat_front_addr":"172.21.15.181:6813/2730863123","state":["exists","up"]},{"osd":6,"uuid":"f51f26d7-29dc-408b-af52-ab6dc9843352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6819","nonce":462044654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6821","nonce":462044654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6825","nonce":462044654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":462044654},{"type":"v1","addr":"172.21.15.28:6823","nonce":462044654}]},"public_addr":"172.21.15.28:6819/462044654","cluster_addr":"172.21.15.28:6821/462044654","heartbeat_back_addr":"172.21.15.28:6825/462044654","heartbeat_front_addr":"172.21.15.28:6823/462044654","state":["exists","up"]},{"osd":7,"uuid":"1e70aae7-a7da-4d72-9e11-46cb44c01307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6817","nonce":3154062983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6819","nonce":3154062983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6823","nonce":3154062983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":3154062983},{"type":"v1","addr":"172.21.15.129:6821","nonce":3154062983}]},"public_addr":"172.21.15.129:6817/3154062983","cluster_addr":"172.21.15.129:6819/3154062983","heartbeat_back_addr":"172.21.15.129:6823/3154062983","heartbeat_front_addr":"172.21.15.129:6821/3154062983","state":["exists","up"]},{"osd":8,"uuid":"e2f14ae0-ab04-4993-b332-289a45f543b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6817","nonce":2560474309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6819","nonce":2560474309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6823","nonce":2560474309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2560474309},{"type":"v1","addr":"172.21.15.181:6821","nonce":2560474309}]},"public_addr":"172.21.15.181:6817/2560474309","cluster_addr":"172.21.15.181:6819/2560474309","heartbeat_back_addr":"172.21.15.181:6823/2560474309","heartbeat_front_addr":"172.21.15.181:6821/2560474309","state":["exists","up"]},{"osd":9,"uuid":"651ea2a8-78a0-42bb-b4a1-b7104aa4a7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6827","nonce":1426799166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6829","nonce":1426799166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6833","nonce":1426799166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1426799166},{"type":"v1","addr":"172.21.15.28:6831","nonce":1426799166}]},"public_addr":"172.21.15.28:6827/1426799166","cluster_addr":"172.21.15.28:6829/1426799166","heartbeat_back_addr":"172.21.15.28:6833/1426799166","heartbeat_front_addr":"172.21.15.28:6831/1426799166","state":["exists","up"]},{"osd":10,"uuid":"e6135ba7-636d-41aa-824b-112eb23712f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6825","nonce":3634135642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6827","nonce":3634135642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6831","nonce":3634135642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":3634135642},{"type":"v1","addr":"172.21.15.129:6829","nonce":3634135642}]},"public_addr":"172.21.15.129:6825/3634135642","cluster_addr":"172.21.15.129:6827/3634135642","heartbeat_back_addr":"172.21.15.129:6831/3634135642","heartbeat_front_addr":"172.21.15.129:6829/3634135642","state":["exists","up"]},{"osd":11,"uuid":"0442b0e3-81cf-42c5-a98b-00f0f4cd9472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6825","nonce":3397668181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6827","nonce":3397668181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6831","nonce":3397668181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3397668181},{"type":"v1","addr":"172.21.15.181:6829","nonce":3397668181}]},"public_addr":"172.21.15.181:6825/3397668181","cluster_addr":"172.21.15.181:6827/3397668181","heartbeat_back_addr":"172.21.15.181:6831/3397668181","heartbeat_front_addr":"172.21.15.181:6829/3397668181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:06.504162+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:31.362681+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:59:55.631661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:21.425477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:46.863004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:12.002282+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:38.107529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:03.990222+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:29.422167+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:55.989967+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:21.112648+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:46.837095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/2008308045":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1068367434":"2024-09-22T06:57:12.164877+0000","172.21.15.28:6801/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/2395738640":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/1550047956":"2024-09-22T06:56:45.859801+0000","172.21.15.28:0/454902326":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/17761675":"2024-09-22T06:57:12.164877+0000","172.21.15.28:0/3368385201":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6801/4061456910":"2024-09-22T06:56:45.859801+0000","172.21.15.28:6800/4061456910":"2024-09-22T06:56:45.859801+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 msgr2=0x7feefc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 0x7feefc0b8aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feef8000c00 tx=0x7feef8031400 comp rx=0 tx=0).stop 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 msgr2=0x7fef101119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef0000d950 tx=0x7fef0000de10 comp rx=0 tx=0).stop 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 shutdown_connections 2024-09-21T07:09:04.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7feefc0b6590 0x7feefc0b8aa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef10108cf0 0x7fef101104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef101083a0 0x7fef1010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 --2- 172.21.15.28:0/3692095807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef10102a60 0x7fef101119c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 >> 172.21.15.28:0/3692095807 conn(0x7fef10079730 msgr2=0x7fef10104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 shutdown_connections 2024-09-21T07:09:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:04.226+0000 7fef1666f640 1 -- 172.21.15.28:0/3692095807 wait complete. 2024-09-21T07:09:04.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:03 smithi181 ceph-mon[34686]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T07:09:04.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:03 smithi129 ceph-mon[34863]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T07:09:04.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T07:09:05.207 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:05.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:04 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3692095807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:05.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:04 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3692095807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:05.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:04 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3692095807' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:05.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 -- 172.21.15.28:0/2548710025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 msgr2=0x7ff3381087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 --2- 172.21.15.28:0/2548710025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff3381087d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff320009900 tx=0x7ff32002a410 comp rx=0 tx=0).stop 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 -- 172.21.15.28:0/2548710025 shutdown_connections 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 --2- 172.21.15.28:0/2548710025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 0x7ff33810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 --2- 172.21.15.28:0/2548710025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff3381087d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.701+0000 7ff33e447640 1 --2- 172.21.15.28:0/2548710025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 0x7ff338102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.702+0000 7ff33e447640 1 -- 172.21.15.28:0/2548710025 >> 172.21.15.28:0/2548710025 conn(0x7ff338079740 msgr2=0x7ff338079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.702+0000 7ff33e447640 1 -- 172.21.15.28:0/2548710025 shutdown_connections 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.702+0000 7ff33e447640 1 -- 172.21.15.28:0/2548710025 wait complete. 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.702+0000 7ff33e447640 1 Processor -- start 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.702+0000 7ff33e447640 1 -- start start 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 0x7ff33819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 0x7ff3381a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111890 con 0x7ff3381083c0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111710 con 0x7ff338102a80 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33e447640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff338111a10 con 0x7ff338108d10 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49334/0 (socket says 172.21.15.28:49334) 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 -- 172.21.15.28:0/2861734434 learned_addr learned my addr 172.21.15.28:0/2861734434 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff337fff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 0x7ff33819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff33c9e4640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 0x7ff3381a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 -- 172.21.15.28:0/2861734434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 msgr2=0x7ff3381a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 0x7ff3381a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 -- 172.21.15.28:0/2861734434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 msgr2=0x7ff33819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 0x7ff33819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 -- 172.21.15.28:0/2861734434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3381a2570 con 0x7ff3381083c0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.703+0000 7ff32ffff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff320032fd0 tx=0x7ff320004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.704+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32003f030 con 0x7ff3381083c0 2024-09-21T07:09:05.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.704+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3381a2800 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.704+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff320004490 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.704+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320035070 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.704+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381a2ce0 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.705+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338103d00 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.707+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7ff320042030 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.707+0000 7ff335ffb640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 0x7ff3240b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.707+0000 7ff337fff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 0x7ff3240b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.707+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff320107c50 con 0x7ff3381083c0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.708+0000 7ff337fff640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 0x7ff3240b8a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff328005e10 tx=0x7ff328005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.710+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3200ce4f0 con 0x7ff3381083c0 2024-09-21T07:09:05.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.938+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff33819d7f0 con 0x7ff3381083c0 2024-09-21T07:09:05.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.941+0000 7ff335ffb640 1 -- 172.21.15.28:0/2861734434 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7ff33819d7f0 con 0x7ff3381083c0 2024-09-21T07:09:05.943 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 msgr2=0x7ff3240b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 0x7ff3240b8a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff328005e10 tx=0x7ff328005da0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 msgr2=0x7ff33819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff320032fd0 tx=0x7ff320004270 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 shutdown_connections 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7ff3240b6540 0x7ff3240b8a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff338108d10 0x7ff3381a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3381083c0 0x7ff33819cc60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 --2- 172.21.15.28:0/2861734434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff338102a80 0x7ff33819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.944+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 >> 172.21.15.28:0/2861734434 conn(0x7ff338079740 msgr2=0x7ff3381043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.945+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 shutdown_connections 2024-09-21T07:09:05.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:05.945+0000 7ff33e447640 1 -- 172.21.15.28:0/2861734434 wait complete. 2024-09-21T07:09:06.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mds[63489]: -- 172.21.15.181:0/1517478697 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55953120f860 con 0x5595353b7180 2024-09-21T07:09:06.269 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: starting mds.i at 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:05 smithi181 ceph-mon[34686]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:05 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:05 smithi181 ceph-mon[34686]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:05 smithi181 ceph-mon[34686]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:05 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.270 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mds[63218]: -- 172.21.15.181:0/2795319349 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564ed6acf860 con 0x564edac77600 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: starting mds.c at 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mds[62946]: -- 172.21.15.181:0/356793001 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562fcda09860 con 0x562fd1bb1600 2024-09-21T07:09:06.271 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: starting mds.f at 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-mds[72477]: -- 172.21.15.28:0/1526806016 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afb5bdb860 con 0x55afb9d83600 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: starting mds.a at 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a[31209]: 2024-09-21T07:09:05.939+0000 7f6c54ed6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-mon[31213]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:09:06.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-mon[31213]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:09:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-mon[31213]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:09:06.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:05 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:05 smithi129 ceph-mon[34863]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:05 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:05 smithi129 ceph-mon[34863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:05 smithi129 ceph-mon[34863]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:05 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/2861734434' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.357 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-mds[63646]: -- 172.21.15.129:0/1474435932 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558ee592b860 con 0x558ee9ad3180 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: starting mds.b at 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: ignoring --setuser ceph since I am not root 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: ignoring --setgroup ceph since I am not root 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-mds[63366]: -- 172.21.15.129:0/1514576414 <== mon.2 v2:172.21.15.129:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b4b6cd860 con 0x558b4f875180 2024-09-21T07:09:06.358 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: starting mds.h at 2024-09-21T07:09:06.721 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:09:06.992 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:07.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-mon[31213]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:09:07.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-mon[31213]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T07:09:07.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:06 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:07.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mon[34686]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:09:07.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mon[34686]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T07:09:07.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:06 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:07.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-mon[34863]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:09:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-mon[34863]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T07:09:07.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:06 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 -- 172.21.15.28:0/3907254167 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 msgr2=0x7fabac112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 --2- 172.21.15.28:0/3907254167 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac112580 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faba4009ca0 tx=0x7faba402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 -- 172.21.15.28:0/3907254167 shutdown_connections 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 --2- 172.21.15.28:0/3907254167 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac112580 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 --2- 172.21.15.28:0/3907254167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 0x7fabac10fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 --2- 172.21.15.28:0/3907254167 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 -- 172.21.15.28:0/3907254167 >> 172.21.15.28:0/3907254167 conn(0x7fabac0ff610 msgr2=0x7fabac101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 -- 172.21.15.28:0/3907254167 shutdown_connections 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.499+0000 7fabb1408640 1 -- 172.21.15.28:0/3907254167 wait complete. 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 Processor -- start 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 -- start start 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 0x7fabac19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fabac115cc0 con 0x7fabac110160 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fabac115b40 con 0x7fabac075730 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.500+0000 7fabb1408640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fabac115e40 con 0x7fabac076080 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49382/0 (socket says 172.21.15.28:49382) 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 -- 172.21.15.28:0/4070556739 learned_addr learned my addr 172.21.15.28:0/4070556739 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7faba27fc640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 0x7fabac19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabaaffd640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 -- 172.21.15.28:0/4070556739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 msgr2=0x7fabac19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 0x7fabac19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 -- 172.21.15.28:0/4070556739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 msgr2=0x7fabac19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 -- 172.21.15.28:0/4070556739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac1a25e0 con 0x7fabac110160 2024-09-21T07:09:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabaaffd640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabab7fe640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faba4005cc0 tx=0x7faba402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4003bf0 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.501+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac1a2870 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.502+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faba4003d90 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.502+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba402fbc0 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.502+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1a9030 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.503+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac075b40 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.504+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7faba402fd60 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.506+0000 7faba8ff9640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 0x7fab980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.506+0000 7fabaaffd640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 0x7fab980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.506+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8469+0+0 (secure 0 0 0) 0x7faba4108af0 con 0x7fabac110160 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.506+0000 7fabaaffd640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 0x7fab980b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0058c0 tx=0x7fab9c005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.509+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faba40cf230 con 0x7fabac110160 2024-09-21T07:09:07.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.738+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fabac1a9290 con 0x7fabac110160 2024-09-21T07:09:07.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.956+0000 7faba8ff9640 1 -- 172.21.15.28:0/4070556739 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7faba40d3610 con 0x7fabac110160 2024-09-21T07:09:07.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 msgr2=0x7fab980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 0x7fab980b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0058c0 tx=0x7fab9c005ec0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 msgr2=0x7fabac1a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faba4005cc0 tx=0x7faba402f380 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 shutdown_connections 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fab980b6510 0x7fab980b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabac110160 0x7fabac1a1eb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fabac076080 0x7fabac19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 --2- 172.21.15.28:0/4070556739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabac075730 0x7fabac19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.959+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 >> 172.21.15.28:0/4070556739 conn(0x7fabac0ff610 msgr2=0x7fabac109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.960+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 shutdown_connections 2024-09-21T07:09:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:07.960+0000 7fabb1408640 1 -- 172.21.15.28:0/4070556739 wait complete. 2024-09-21T07:09:08.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6834/2946494864,v1:172.21.15.181:6835/2946494864] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6836/3770629320,v1:172.21.15.129:6838/3770629320] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.129:6837/4029365642,v1:172.21.15.129:6839/4029365642] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.28:6840/3757793417,v1:172.21.15.28:6841/3757793417] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6837/3317418236,v1:172.21.15.181:6839/3317418236] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: mds.? [v2:172.21.15.181:6836/535733568,v1:172.21.15.181:6838/535733568] up:boot 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:09:08.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:09:08.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:09:08.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:07 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:09:08.275 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:08.275 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6834/2946494864,v1:172.21.15.181:6835/2946494864] up:boot 2024-09-21T07:09:08.275 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6836/3770629320,v1:172.21.15.129:6838/3770629320] up:boot 2024-09-21T07:09:08.275 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.129:6837/4029365642,v1:172.21.15.129:6839/4029365642] up:boot 2024-09-21T07:09:08.275 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.28:6840/3757793417,v1:172.21.15.28:6841/3757793417] up:boot 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6837/3317418236,v1:172.21.15.181:6839/3317418236] up:boot 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: mds.? [v2:172.21.15.181:6836/535733568,v1:172.21.15.181:6838/535733568] up:boot 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:09:08.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:07 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:09:08.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6834/2946494864,v1:172.21.15.181:6835/2946494864] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6836/3770629320,v1:172.21.15.129:6838/3770629320] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.129:6837/4029365642,v1:172.21.15.129:6839/4029365642] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.28:6840/3757793417,v1:172.21.15.28:6841/3757793417] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6837/3317418236,v1:172.21.15.181:6839/3317418236] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: mds.? [v2:172.21.15.181:6836/535733568,v1:172.21.15.181:6838/535733568] up:boot 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:09:08.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:09:08.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='mgr.14152 172.21.15.28:0/2873825530' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:09:08.358 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:07 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:09:08.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:09:08.927 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:09.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:08 smithi181 ceph-mon[34686]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:09:09.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:08 smithi181 ceph-mon[34686]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:09:09.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:08 smithi181 ceph-mon[34686]: Cluster is now healthy 2024-09-21T07:09:09.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:08 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:09:09.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:08 smithi181 ceph-mon[34686]: fsmap 12 up:standby 2024-09-21T07:09:09.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:08 smithi028 ceph-mon[31213]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:09:09.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:08 smithi028 ceph-mon[31213]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:09:09.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:08 smithi028 ceph-mon[31213]: Cluster is now healthy 2024-09-21T07:09:09.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:08 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:09:09.228 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:08 smithi028 ceph-mon[31213]: fsmap 12 up:standby 2024-09-21T07:09:09.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:08 smithi129 ceph-mon[34863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:09:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:08 smithi129 ceph-mon[34863]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:09:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:08 smithi129 ceph-mon[34863]: Cluster is now healthy 2024-09-21T07:09:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:08 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/4070556739' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:09:09.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:08 smithi129 ceph-mon[34863]: fsmap 12 up:standby 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3631077740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 msgr2=0x7fc3a010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3631077740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a010d8d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc394009900 tx=0x7fc39402a410 comp rx=0 tx=0).stop 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3631077740 shutdown_connections 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3631077740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a010de10 0x7fc3a01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3631077740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a010d8d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3631077740 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a0104860 0x7fc3a0104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3631077740 >> 172.21.15.28:0/3631077740 conn(0x7fc3a0079730 msgr2=0x7fc3a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3631077740 shutdown_connections 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.441+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3631077740 wait complete. 2024-09-21T07:09:09.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 Processor -- start 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 -- start start 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 0x7fc3a0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a010de10 0x7fc3a01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113aa0 con 0x7fc3a0105290 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113920 con 0x7fc3a010de10 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a7f6d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0113c20 con 0x7fc3a0104860 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a5508640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a5508640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49398/0 (socket says 172.21.15.28:49398) 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a5508640 1 -- 172.21.15.28:0/3801735722 learned_addr learned my addr 172.21.15.28:0/3801735722 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.442+0000 7fc3a650a640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a010de10 0x7fc3a01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5d09640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 0x7fc3a0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:09.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 -- 172.21.15.28:0/3801735722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 msgr2=0x7fc3a0102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 0x7fc3a0102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 -- 172.21.15.28:0/3801735722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a010de10 msgr2=0x7fc3a01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a010de10 0x7fc3a01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 -- 172.21.15.28:0/3801735722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a01a8790 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5d09640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 0x7fc3a0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a5508640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc39402a930 tx=0x7fc394004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39403f030 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc394003aa0 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a01a8a20 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394035070 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.443+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a8f80 con 0x7fc3a0105290 2024-09-21T07:09:09.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.444+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a0104c70 con 0x7fc3a0105290 2024-09-21T07:09:09.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.446+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc394042030 con 0x7fc3a0105290 2024-09-21T07:09:09.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.447+0000 7fc39effd640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 0x7fc3880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:09.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.447+0000 7fc3a5d09640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 0x7fc3880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:09.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.447+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8469+0+0 (secure 0 0 0) 0x7fc394107b80 con 0x7fc3a0105290 2024-09-21T07:09:09.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.448+0000 7fc3a5d09640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 0x7fc3880b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3a01041c0 tx=0x7fc390009400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:09.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.452+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3940ce320 con 0x7fc3a0105290 2024-09-21T07:09:09.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.644+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3a002e640 con 0x7fc3a0105290 2024-09-21T07:09:09.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.974+0000 7fc39effd640 1 -- 172.21.15.28:0/3801735722 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7fc3940d2700 con 0x7fc3a0105290 2024-09-21T07:09:09.977 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:09:09.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.977+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 msgr2=0x7fc3880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:09.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.977+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 0x7fc3880b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3a01041c0 tx=0x7fc390009400 comp rx=0 tx=0).stop 2024-09-21T07:09:09.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.977+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 msgr2=0x7fc3a0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:09.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.977+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc39402a930 tx=0x7fc394004270 comp rx=0 tx=0).stop 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 shutdown_connections 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fc3880b6510 0x7fc3880b8a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3a010de10 0x7fc3a01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a0105290 0x7fc3a0102cb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 --2- 172.21.15.28:0/3801735722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3a0104860 0x7fc3a0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 >> 172.21.15.28:0/3801735722 conn(0x7fc3a0079730 msgr2=0x7fc3a0100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:09.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 shutdown_connections 2024-09-21T07:09:09.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:09.979+0000 7fc3a7f6d640 1 -- 172.21.15.28:0/3801735722 wait complete. 2024-09-21T07:09:10.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:09 smithi181 ceph-mon[34686]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:10.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:09 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:10.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:09 smithi028 ceph-mon[31213]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:10.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:09 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:10.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:09 smithi129 ceph-mon[34863]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T07:09:10.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:09 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:10.756 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:09:11.024 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:11.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:10 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:11.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:10 smithi181 ceph-mon[34686]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:09:11.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:10 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:11.276 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:10 smithi028 ceph-mon[31213]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:09:11.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:10 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/3801735722' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:11.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:10 smithi129 ceph-mon[34863]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:09:11.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.510+0000 7fed6c8bb640 1 -- 172.21.15.28:0/8529642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68108d70 msgr2=0x7fed6810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.510+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/8529642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68108d70 0x7fed6810f5a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ca0 tx=0x7fed6002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 -- 172.21.15.28:0/8529642 shutdown_connections 2024-09-21T07:09:11.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/8529642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68108d70 0x7fed6810f5a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/8529642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 0x7fed68108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/8529642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68102ae0 0x7fed68102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 -- 172.21.15.28:0/8529642 >> 172.21.15.28:0/8529642 conn(0x7fed68079770 msgr2=0x7fed68079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 -- 172.21.15.28:0/8529642 shutdown_connections 2024-09-21T07:09:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 -- 172.21.15.28:0/8529642 wait complete. 2024-09-21T07:09:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.511+0000 7fed6c8bb640 1 Processor -- start 2024-09-21T07:09:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 -- start start 2024-09-21T07:09:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 0x7fed6819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68108d70 0x7fed6819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed68112a30 con 0x7fed68102ae0 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fed681128b0 con 0x7fed68108d70 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6c8bb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed68112bb0 con 0x7fed68108420 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49414/0 (socket says 172.21.15.28:49414) 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 -- 172.21.15.28:0/768769856 learned_addr learned my addr 172.21.15.28:0/768769856 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed65d9b640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 0x7fed6819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed66d9d640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68108d70 0x7fed6819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 -- 172.21.15.28:0/768769856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 msgr2=0x7fed6819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 0x7fed6819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 -- 172.21.15.28:0/768769856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68108d70 msgr2=0x7fed6819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68108d70 0x7fed6819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.512+0000 7fed6659c640 1 -- 172.21.15.28:0/768769856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed681a0420 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed6659c640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d950 tx=0x7fed5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58017070 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed58009c30 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5800f620 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed681a0710 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.513+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed681a6e70 con 0x7fed68102ae0 2024-09-21T07:09:11.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.514+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed68103d60 con 0x7fed68102ae0 2024-09-21T07:09:11.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.516+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fed58005030 con 0x7fed68102ae0 2024-09-21T07:09:11.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.517+0000 7fed5f7fe640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 0x7fed540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.517+0000 7fed65d9b640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 0x7fed540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.517+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7973+0+0 (secure 0 0 0) 0x7fed580e6c50 con 0x7fed68102ae0 2024-09-21T07:09:11.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.517+0000 7fed65d9b640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 0x7fed540b8aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fed68108110 tx=0x7fed5000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.520+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed58009de0 con 0x7fed68102ae0 2024-09-21T07:09:11.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.711+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fed68102ef0 con 0x7fed68102ae0 2024-09-21T07:09:11.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.983+0000 7fed5f7fe640 1 -- 172.21.15.28:0/768769856 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7fed580b1a90 con 0x7fed68102ae0 2024-09-21T07:09:11.984 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-09-21T07:09:11.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 msgr2=0x7fed540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 0x7fed540b8aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fed68108110 tx=0x7fed5000a250 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 msgr2=0x7fed6819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d950 tx=0x7fed5800de10 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 shutdown_connections 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:6800/2420223587,v1:172.21.15.28:6801/2420223587] conn(0x7fed540b6590 0x7fed540b8aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed68108d70 0x7fed6819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed68108420 0x7fed6819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 --2- 172.21.15.28:0/768769856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed68102ae0 0x7fed6819a4b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 >> 172.21.15.28:0/768769856 conn(0x7fed68079770 msgr2=0x7fed68101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 shutdown_connections 2024-09-21T07:09:11.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-21T07:09:11.986+0000 7fed6c8bb640 1 -- 172.21.15.28:0/768769856 wait complete. 2024-09-21T07:09:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:11 smithi181 ceph-mon[34686]: pgmap v425: 65 pgs: 65 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:09:12.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:11 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:11 smithi028 ceph-mon[31213]: pgmap v425: 65 pgs: 65 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:09:12.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:11 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:12.356 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:11 smithi129 ceph-mon[34863]: pgmap v425: 65 pgs: 65 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:09:12.357 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:11 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:09:12.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:09:12.817 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:09:12.851 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:09:12.885 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T07:09:12.886 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:09:12.903 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:09:12.921 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:09:12.942 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T07:09:12.942 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T07:09:12.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:09:13.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:12 smithi028 systemd[1]: Stopping Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:13.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:12 smithi028 ceph-mon[31213]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:13.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:12 smithi028 ceph-mon[31213]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:09:13.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:12 smithi129 ceph-mon[34863]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:13.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:12 smithi129 ceph-mon[34863]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:09:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:13 smithi181 ceph-mon[34686]: from='client.? 172.21.15.28:0/768769856' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:09:13.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:13 smithi181 ceph-mon[34686]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:09:13.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a[31209]: 2024-09-21T07:09:13.292+0000 7f6c5a6e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:13.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a[31209]: 2024-09-21T07:09:13.292+0000 7f6c5a6e1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T07:09:13.548 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:13 smithi028 podman[85386]: 2024-09-21 07:09:13.396869537 +0000 UTC m=+0.241524041 container died dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:09:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:13 smithi028 podman[85386]: 2024-09-21 07:09:13.806646247 +0000 UTC m=+0.651300751 container cleanup dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:09:14.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:13 smithi028 bash[85386]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:09:14.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T07:09:14.322 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:14 smithi028 podman[85399]: 2024-09-21 07:09:14.058084399 +0000 UTC m=+0.658550695 container remove dca5c62bfebe1f8703068a0fcdb6d5c355733218f3f7c9201cde97020c530a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T07:09:14.322 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:14 smithi028 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:09:14.322 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:14 smithi028 systemd[1]: Stopped Ceph mon.a for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:09:14.322 INFO:journalctl@ceph.mon.a.smithi028.stdout:Sep 21 07:09:14 smithi028 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.a.service: Consumed 13.722s CPU time. 2024-09-21T07:09:14.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:14.360 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T07:09:14.360 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T07:09:14.360 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.b 2024-09-21T07:09:14.663 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:14 smithi129 systemd[1]: Stopping Ceph mon.b for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:15.106 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b[34859]: 2024-09-21T07:09:14.661+0000 7f17294fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:15.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b[34859]: 2024-09-21T07:09:14.661+0000 7f17294fd640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:09:15.107 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:14 smithi129 podman[65956]: 2024-09-21 07:09:14.815164891 +0000 UTC m=+0.255406235 container died 9250081be069202265f2e649c32116a659235a890b8ddbd4ff4d73ae93c32991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T07:09:15.573 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 podman[65956]: 2024-09-21 07:09:15.337346626 +0000 UTC m=+0.777587969 container cleanup 9250081be069202265f2e649c32116a659235a890b8ddbd4ff4d73ae93c32991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:09:15.573 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 bash[65956]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b 2024-09-21T07:09:15.804 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T07:09:15.825 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 podman[65968]: 2024-09-21 07:09:15.572341123 +0000 UTC m=+0.754244787 container remove 9250081be069202265f2e649c32116a659235a890b8ddbd4ff4d73ae93c32991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:09:15.826 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T07:09:15.826 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 systemd[1]: Stopped Ceph mon.b for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:09:15.826 INFO:journalctl@ceph.mon.b.smithi129.stdout:Sep 21 07:09:15 smithi129 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.b.service: Consumed 8.416s CPU time. 2024-09-21T07:09:15.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:15.859 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T07:09:15.859 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T07:09:15.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.c 2024-09-21T07:09:16.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:15 smithi181 systemd[1]: Stopping Ceph mon.c for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:16.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c[34682]: 2024-09-21T07:09:16.174+0000 7f8f30324640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:16.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c[34682]: 2024-09-21T07:09:16.174+0000 7f8f30324640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:09:16.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:16 smithi181 podman[65758]: 2024-09-21 07:09:16.31832106 +0000 UTC m=+0.258603688 container died 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:09:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:16 smithi181 podman[65758]: 2024-09-21 07:09:16.776113358 +0000 UTC m=+0.716395968 container cleanup 2b2c7be052156f9e2a578711f348c6603be3c517d105ac27c03914d05e251060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T07:09:17.019 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 07:09:16 smithi181 bash[65758]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mon-c 2024-09-21T07:09:17.196 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T07:09:17.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:17.242 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T07:09:17.243 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T07:09:17.243 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:09:17.548 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:09:17 smithi028 systemd[1]: Stopping Ceph mgr.x for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:17.905 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:09:17 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T07:09:17.569+0000 7f8a099aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:17.905 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:09:17 smithi028 podman[85508]: 2024-09-21 07:09:17.600407627 +0000 UTC m=+0.158668442 container died 91a0a7905358934fc80e6b0071901f2ecd21ee61350bc1fa1a67464a46136f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:09:18.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:09:18 smithi028 podman[85508]: 2024-09-21 07:09:18.104143549 +0000 UTC m=+0.662404362 container cleanup 91a0a7905358934fc80e6b0071901f2ecd21ee61350bc1fa1a67464a46136f36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T07:09:18.298 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Sep 21 07:09:18 smithi028 bash[85508]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-x 2024-09-21T07:09:18.543 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T07:09:18.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:18.579 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T07:09:18.579 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T07:09:18.579 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.y 2024-09-21T07:09:18.856 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 07:09:18 smithi129 systemd[1]: Stopping Ceph mgr.y for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:19.228 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 07:09:18 smithi129 podman[66083]: 2024-09-21 07:09:18.930232681 +0000 UTC m=+0.156372369 container died b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T07:09:19.607 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 07:09:19 smithi129 podman[66083]: 2024-09-21 07:09:19.418599049 +0000 UTC m=+0.644738768 container cleanup b1e5600d22b96068ca540b0bc348d40fdce4b260193e2bcee216518e464753d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:09:19.607 INFO:journalctl@ceph.mgr.y.smithi129.stdout:Sep 21 07:09:19 smithi129 bash[66083]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-y 2024-09-21T07:09:19.844 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T07:09:19.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:19.878 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T07:09:19.879 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T07:09:19.879 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.z 2024-09-21T07:09:20.245 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:19 smithi181 systemd[1]: Stopping Ceph mgr.z for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:20.519 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:20 smithi181 podman[65881]: 2024-09-21 07:09:20.24418569 +0000 UTC m=+0.173898179 container died 6ba9c735d6d2f037f7dcd299d82c422882a8986a41b83438731ae98a5f0ea885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:09:21.019 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:20 smithi181 podman[65881]: 2024-09-21 07:09:20.674566199 +0000 UTC m=+0.604278725 container cleanup 6ba9c735d6d2f037f7dcd299d82c422882a8986a41b83438731ae98a5f0ea885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T07:09:21.019 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:20 smithi181 bash[65881]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-z 2024-09-21T07:09:21.019 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:20 smithi181 podman[65894]: 2024-09-21 07:09:20.867863923 +0000 UTC m=+0.617831341 container remove 6ba9c735d6d2f037f7dcd299d82c422882a8986a41b83438731ae98a5f0ea885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T07:09:21.020 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 07:09:20 smithi181 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T07:09:21.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T07:09:21.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:21.128 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T07:09:21.128 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T07:09:21.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.0 2024-09-21T07:09:21.452 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:21 smithi028 systemd[1]: Stopping Ceph osd.0 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:21.798 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T07:09:21.450+0000 7ff166e67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:21.798 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T07:09:21.450+0000 7ff166e67640 -1 osd.0 77 *** Got signal Terminated *** 2024-09-21T07:09:21.798 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0[46634]: 2024-09-21T07:09:21.450+0000 7ff166e67640 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:09:27.112 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:26 smithi028 podman[85632]: 2024-09-21 07:09:26.817576544 +0000 UTC m=+5.489023509 container died 24b4ecebaee4f0e70e0c4142fffb1a097f161e112604cb46265e9f61e47a7230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:27.548 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:27 smithi028 podman[85632]: 2024-09-21 07:09:27.301532269 +0000 UTC m=+5.972979232 container cleanup 24b4ecebaee4f0e70e0c4142fffb1a097f161e112604cb46265e9f61e47a7230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:09:27.548 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:27 smithi028 bash[85632]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0 2024-09-21T07:09:27.939 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:27 smithi028 podman[85647]: 2024-09-21 07:09:27.595265782 +0000 UTC m=+0.779691563 container remove 24b4ecebaee4f0e70e0c4142fffb1a097f161e112604cb46265e9f61e47a7230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T07:09:28.203 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:27 smithi028 podman[85736]: 2024-09-21 07:09:27.842922704 +0000 UTC m=+0.021195733 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:09:28.203 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:28 smithi028 podman[85736]: 2024-09-21 07:09:28.079672066 +0000 UTC m=+0.257945087 container create 843580b03e7b7b7af9ca103d427d55da8467622ae88f7735c5e10c5daa115c3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T07:09:28.540 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:28 smithi028 podman[85736]: 2024-09-21 07:09:28.340837493 +0000 UTC m=+0.519110514 container init 843580b03e7b7b7af9ca103d427d55da8467622ae88f7735c5e10c5daa115c3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T07:09:28.540 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:28 smithi028 podman[85736]: 2024-09-21 07:09:28.344309918 +0000 UTC m=+0.522582942 container start 843580b03e7b7b7af9ca103d427d55da8467622ae88f7735c5e10c5daa115c3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T07:09:28.540 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:28 smithi028 podman[85736]: 2024-09-21 07:09:28.440540676 +0000 UTC m=+0.618813698 container attach 843580b03e7b7b7af9ca103d427d55da8467622ae88f7735c5e10c5daa115c3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T07:09:28.798 INFO:journalctl@ceph.osd.0.smithi028.stdout:Sep 21 07:09:28 smithi028 podman[85736]: 2024-09-21 07:09:28.539073027 +0000 UTC m=+0.717346049 container died 843580b03e7b7b7af9ca103d427d55da8467622ae88f7735c5e10c5daa115c3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:09:29.289 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T07:09:29.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:29.333 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T07:09:29.333 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T07:09:29.333 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.1 2024-09-21T07:09:29.650 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:29 smithi129 systemd[1]: Stopping Ceph osd.1 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:30.107 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T07:09:29.647+0000 7f4ec6b8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:30.107 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T07:09:29.647+0000 7f4ec6b8d640 -1 osd.1 77 *** Got signal Terminated *** 2024-09-21T07:09:30.107 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1[38786]: 2024-09-21T07:09:29.647+0000 7f4ec6b8d640 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:09:35.357 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:35 smithi129 podman[66217]: 2024-09-21 07:09:35.093839248 +0000 UTC m=+5.565637300 container died 506fde3775ca468a47cd4c9bb5611f723b894f18a9d20d477b2532f93e302edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:35.858 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:35 smithi129 podman[66217]: 2024-09-21 07:09:35.640516899 +0000 UTC m=+6.112314946 container cleanup 506fde3775ca468a47cd4c9bb5611f723b894f18a9d20d477b2532f93e302edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:09:35.858 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:35 smithi129 bash[66217]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1 2024-09-21T07:09:36.320 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:35 smithi129 podman[66234]: 2024-09-21 07:09:35.959104275 +0000 UTC m=+0.861822146 container remove 506fde3775ca468a47cd4c9bb5611f723b894f18a9d20d477b2532f93e302edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:09:36.580 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.221983235 +0000 UTC m=+0.015811914 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:09:36.580 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.343226954 +0000 UTC m=+0.137055625 container create 75c15b77984c9fff1746eb8e659953403565abd575eb2c5661ae8df08258d4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:36.857 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.579044305 +0000 UTC m=+0.372872973 container init 75c15b77984c9fff1746eb8e659953403565abd575eb2c5661ae8df08258d4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-21T07:09:36.857 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.582463641 +0000 UTC m=+0.376292323 container start 75c15b77984c9fff1746eb8e659953403565abd575eb2c5661ae8df08258d4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:09:36.857 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.679145598 +0000 UTC m=+0.472974292 container attach 75c15b77984c9fff1746eb8e659953403565abd575eb2c5661ae8df08258d4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:09:36.857 INFO:journalctl@ceph.osd.1.smithi129.stdout:Sep 21 07:09:36 smithi129 podman[66322]: 2024-09-21 07:09:36.776764268 +0000 UTC m=+0.570592949 container died 75c15b77984c9fff1746eb8e659953403565abd575eb2c5661ae8df08258d4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:09:37.471 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T07:09:37.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:37.513 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T07:09:37.513 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T07:09:37.513 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.2 2024-09-21T07:09:37.805 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:37 smithi181 systemd[1]: Stopping Ceph osd.2 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:38.074 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T07:09:37.803+0000 7f90c66a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:38.074 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T07:09:37.803+0000 7f90c66a0640 -1 osd.2 77 *** Got signal Terminated *** 2024-09-21T07:09:38.074 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2[38959]: 2024-09-21T07:09:37.803+0000 7f90c66a0640 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:09:43.615 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:43 smithi181 podman[66007]: 2024-09-21 07:09:43.288780183 +0000 UTC m=+5.577870832 container died 76b436b904f9762b7ed15bcb0708163b5d2d725bb2ec7c8353efbe4cad9c9c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:09:43.939 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:43 smithi181 podman[66007]: 2024-09-21 07:09:43.695371189 +0000 UTC m=+5.984461811 container cleanup 76b436b904f9762b7ed15bcb0708163b5d2d725bb2ec7c8353efbe4cad9c9c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:09:43.939 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:43 smithi181 bash[66007]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2 2024-09-21T07:09:44.266 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:43 smithi181 podman[66033]: 2024-09-21 07:09:43.93853737 +0000 UTC m=+0.646197739 container remove 76b436b904f9762b7ed15bcb0708163b5d2d725bb2ec7c8353efbe4cad9c9c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:44.519 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.168301333 +0000 UTC m=+0.016061243 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:09:44.519 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.289651842 +0000 UTC m=+0.137411783 container create 37b010d9e7d3bd14b132e52808ee902e93c7205a17de4842a4e61afd262cf618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:45.019 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.542822719 +0000 UTC m=+0.390582627 container init 37b010d9e7d3bd14b132e52808ee902e93c7205a17de4842a4e61afd262cf618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:09:45.019 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.546262714 +0000 UTC m=+0.394022622 container start 37b010d9e7d3bd14b132e52808ee902e93c7205a17de4842a4e61afd262cf618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T07:09:45.020 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.659367319 +0000 UTC m=+0.507127229 container attach 37b010d9e7d3bd14b132e52808ee902e93c7205a17de4842a4e61afd262cf618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:45.020 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 07:09:44 smithi181 podman[66122]: 2024-09-21 07:09:44.740205259 +0000 UTC m=+0.587965166 container died 37b010d9e7d3bd14b132e52808ee902e93c7205a17de4842a4e61afd262cf618 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T07:09:45.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T07:09:45.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:45.492 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T07:09:45.492 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T07:09:45.492 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.3 2024-09-21T07:09:45.780 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:45 smithi028 systemd[1]: Stopping Ceph osd.3 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:46.040 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:45 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:09:45.824+0000 7fa2a0fd9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:46.040 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:45 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:09:45.824+0000 7fa2a0fd9640 -1 osd.3 77 *** Got signal Terminated *** 2024-09-21T07:09:46.040 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:45 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3[52896]: 2024-09-21T07:09:45.824+0000 7fa2a0fd9640 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:09:48.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:47.879+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:48.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:47.873+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:48.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:48 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:48.201+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:48.798 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:48 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:48.329+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:49.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:48.889+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:48.887+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:49.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:49 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:49.199+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:49.798 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:49 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:49.327+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:50.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:49.921+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:50.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:49.843+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:50.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:50 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:50.217+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:50.701 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:50 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:50.297+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:51.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:50 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:50.700+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:51.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:50.958+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:51.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:50.820+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:51.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:50.884+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:51.500 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:51 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:51.255+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:51.500 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:51 smithi028 podman[85840]: 2024-09-21 07:09:51.197120203 +0000 UTC m=+5.506736359 container died 76dd09db020a95d4047543ba50b267efc182ef2cd5461dc4af421232a06ee620 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T07:09:51.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:51 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:51.215+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:51.798 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:51 smithi028 podman[85840]: 2024-09-21 07:09:51.706372965 +0000 UTC m=+6.015989161 container cleanup 76dd09db020a95d4047543ba50b267efc182ef2cd5461dc4af421232a06ee620 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:09:51.798 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:51 smithi028 bash[85840]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3 2024-09-21T07:09:51.798 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:51 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:51.688+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:52.248 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:51 smithi028 podman[85867]: 2024-09-21 07:09:51.966317821 +0000 UTC m=+0.769621945 container remove 76dd09db020a95d4047543ba50b267efc182ef2cd5461dc4af421232a06ee620 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T07:09:52.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:51.942+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:52.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:51.795+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:52.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:51.847+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:52.526 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.286795816 +0000 UTC m=+0.016444649 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:09:52.527 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:52.246+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:52.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:52 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:52.230+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:52.787 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.525807496 +0000 UTC m=+0.255456321 container create 0002e4cbc9af192bd30f19aa8ea6f18374eb808b59320297bf5860c9aefa0482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:09:52.787 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:52 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:52.725+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:53.050 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.786601423 +0000 UTC m=+0.516250260 container init 0002e4cbc9af192bd30f19aa8ea6f18374eb808b59320297bf5860c9aefa0482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:09:53.050 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.790091989 +0000 UTC m=+0.519740812 container start 0002e4cbc9af192bd30f19aa8ea6f18374eb808b59320297bf5860c9aefa0482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:53.050 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.878426238 +0000 UTC m=+0.608075077 container attach 0002e4cbc9af192bd30f19aa8ea6f18374eb808b59320297bf5860c9aefa0482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:53.050 INFO:journalctl@ceph.osd.3.smithi028.stdout:Sep 21 07:09:52 smithi028 podman[85953]: 2024-09-21 07:09:52.987183211 +0000 UTC m=+0.716832036 container died 0002e4cbc9af192bd30f19aa8ea6f18374eb808b59320297bf5860c9aefa0482 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T07:09:53.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:52.938+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:53.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:52.790+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:53.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:52.889+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:53.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:53 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:53.251+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:53.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:53 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:53.251+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:53.705 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T07:09:53.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:09:53.753 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T07:09:53.754 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T07:09:53.754 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.4 2024-09-21T07:09:54.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:53 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:53.740+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:54.107 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:53 smithi129 systemd[1]: Stopping Ceph osd.4 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:09:54.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:53.976+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:54.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:53.818+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:54.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:53.900+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:54.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:54.210+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:54.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:54 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:54.205+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:54.607 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:54 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:54.107+0000 7f0fb585e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:09:54.607 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:54 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:54.107+0000 7f0fb585e640 -1 osd.4 77 *** Got signal Terminated *** 2024-09-21T07:09:54.607 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:54 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:54.107+0000 7f0fb585e640 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:09:55.047 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:54 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:54.779+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:55.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:54.983+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:55.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:54.792+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:55.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:54.871+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:55.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:55 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:55.162+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:55.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:55 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:55.191+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:56.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:55 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:55.777+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:56.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:55 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:55.777+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:09:56.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:55 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:55.832+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:56.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:56.009+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:56.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:55 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:55.831+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:56.544 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:56.148+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:56.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:56 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:56.241+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:57.106 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:56 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:56.716+0000 7f0fb1e49640 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.498453+0000 front 2024-09-21T07:09:33.498427+0000 (oldest deadline 2024-09-21T07:09:55.798587+0000) 2024-09-21T07:09:57.126 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:56.814+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:57.126 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:56.814+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:09:57.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:56.874+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:57.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:57 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:57.029+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:57.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:56.843+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:57.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:56 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:56.843+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:09:57.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:57 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:57.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:57.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:57 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:57.279+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:57.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:57 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:57.279+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:09:58.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:09:57 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:09:57.695+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:09:58.107 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:57 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:57.757+0000 7f0fb1e49640 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.498453+0000 front 2024-09-21T07:09:33.498427+0000 (oldest deadline 2024-09-21T07:09:55.798587+0000) 2024-09-21T07:09:58.121 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:57 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:57.797+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:58.121 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:57 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:57.797+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:09:58.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:57 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:57.832+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:58.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:58 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:58.055+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:58.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:58 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:58.055+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:09:58.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:57 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:57.823+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:58.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:57 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:57.823+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:09:58.381 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:58 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:58.322+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:58.381 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:58 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:58.322+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:09:58.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:58 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:58.120+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:58.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:58 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:58.120+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:09:59.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:58 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:58.756+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:09:59.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:58 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:58.756+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:09:59.106 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:58 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4[45197]: 2024-09-21T07:09:58.725+0000 7f0fb1e49640 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.498453+0000 front 2024-09-21T07:09:33.498427+0000 (oldest deadline 2024-09-21T07:09:55.798587+0000) 2024-09-21T07:09:59.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:09:58 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:09:58.738+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:09:59.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:58 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:58.821+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:09:59.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:59.043+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:09:59.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:09:59.043+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:09:59.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:58 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:58.834+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:09:59.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:58 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:58.834+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:09:59.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:59.089+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:09:59.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:09:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:09:59.089+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:09:59.606 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:59 smithi129 podman[66425]: 2024-09-21 07:09:59.424021164 +0000 UTC m=+5.462457175 container died 6d0c2b7b130205f9b824ed8a4246aa2971f87303d834dd44076199f89e703fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T07:09:59.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:59 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:59.286+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:09:59.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:09:59 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:09:59.286+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:00.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:59.712+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:00.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:09:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:09:59.712+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:00.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:59.826+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:00.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:09:59.826+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:00.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:59.809+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:00.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:09:59 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:09:59.809+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:00.097 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:59 smithi129 podman[66425]: 2024-09-21 07:09:59.827833318 +0000 UTC m=+5.866269318 container cleanup 6d0c2b7b130205f9b824ed8a4246aa2971f87303d834dd44076199f89e703fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:10:00.097 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:09:59 smithi129 bash[66425]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4 2024-09-21T07:10:00.097 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:09:59 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:09:59.725+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:00.356 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66452]: 2024-09-21 07:10:00.096124152 +0000 UTC m=+0.667889741 container remove 6d0c2b7b130205f9b824ed8a4246aa2971f87303d834dd44076199f89e703fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:00.357 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:00 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:00.268+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:00.357 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:00 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:00.268+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:00.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:00.069+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:00.520 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:00.069+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:00.547 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:00 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:00.118+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:00.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:00 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:00.118+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:00.808 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:00 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:00.744+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:00.809 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.403299582 +0000 UTC m=+0.016099646 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:00.809 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.539037329 +0000 UTC m=+0.151837433 container create 43110a35dae4200733a015c9a8db70dd003fc971db7ff56462ad2b6cda505eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T07:10:00.809 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.807999147 +0000 UTC m=+0.420799208 container init 43110a35dae4200733a015c9a8db70dd003fc971db7ff56462ad2b6cda505eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:01.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:00 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:00.747+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:01.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:00 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:00.747+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:01.107 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.811296634 +0000 UTC m=+0.424096696 container start 43110a35dae4200733a015c9a8db70dd003fc971db7ff56462ad2b6cda505eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:01.107 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.907939298 +0000 UTC m=+0.520739370 container attach 43110a35dae4200733a015c9a8db70dd003fc971db7ff56462ad2b6cda505eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T07:10:01.107 INFO:journalctl@ceph.osd.4.smithi129.stdout:Sep 21 07:10:00 smithi129 podman[66545]: 2024-09-21 07:10:00.995197156 +0000 UTC m=+0.607997215 container died 43110a35dae4200733a015c9a8db70dd003fc971db7ff56462ad2b6cda505eef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T07:10:01.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:00.848+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:01.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:00.848+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:01.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:01.038+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:01.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:01.038+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:01.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:00.829+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:01.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:00 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:00.829+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:01.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:01 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:01.085+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:01.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:01 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:01.085+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:01.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:01 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:01.299+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:01.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:01 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:01.299+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:01.683 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T07:10:01.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:01.722 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T07:10:01.722 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T07:10:01.723 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.5 2024-09-21T07:10:02.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:01 smithi181 systemd[1]: Stopping Ceph osd.5 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:02.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:01.812+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:02.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:01.812+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:02.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:01.808+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:02.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:01 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:01.808+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:02.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:01 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:01.788+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:02.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:01 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:01.788+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:02.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:01 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:01.783+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:02.519 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:02.062+0000 7f80110d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:02.519 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:02.062+0000 7f80110d2640 -1 osd.5 77 *** Got signal Terminated *** 2024-09-21T07:10:02.520 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:02.062+0000 7f80110d2640 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:02.520 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:02.086+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:02.520 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:02.086+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:02.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:02 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:02.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:02.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:02 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:02.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:02.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:02 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:02.331+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:02.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:02 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:02.331+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:03.049 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:02.802+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:03.049 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:02.802+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:03.049 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:02.790+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:03.049 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:02 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:02.790+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:03.066 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:02 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:02.812+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:03.066 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:02 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:02.812+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:03.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:02 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:02.737+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:03.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:03.047+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:03.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:03.047+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:03.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:03 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:03.064+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:03.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:03 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:03.064+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:03.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:03 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:03.289+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:03.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:03 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:03.289+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:04.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:03 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:03.742+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:04.108 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:03 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:03.848+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:04.108 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:03 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:03.848+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:04.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:03.797+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:04.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:03.797+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:04.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:04.036+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:04.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:04.036+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:04.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:04.036+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:04.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:03.792+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:04.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:03 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:03.792+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:04.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:04.106+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:04.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:04.106+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:04.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:04.106+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:04.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:04 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:04.309+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:04.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:04 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:04.309+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:04.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:04 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:04.309+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:05.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:04.799+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:05.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:04.799+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:05.019 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:04.765+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:05.019 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:04.765+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:05.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:04 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:04.765+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:05.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:04 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:04.779+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:05.122 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:04.855+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:05.122 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:04.855+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:05.122 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:04.855+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:05.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:05.067+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:05.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:05.067+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:05.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:05.067+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:05.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:05.119+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:05.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:05.119+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:05.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:05.119+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:05.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:05.302+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:05.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:05.302+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:05.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:05.302+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:06.050 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:05.819+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:06.051 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:05.819+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:06.051 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:05.819+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:38.918782+0000 front 2024-09-21T07:09:38.918857+0000 (oldest deadline 2024-09-21T07:10:04.818918+0000) 2024-09-21T07:10:06.051 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:05.777+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:06.051 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:05.777+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:06.051 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:05 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:05.777+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:06.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:05.809+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:06.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:05 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:05.809+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:06.145 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:05.827+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:06.145 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:05.827+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:06.145 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:05 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:05.827+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:06.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:06.049+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:06.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:06.049+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:06.519 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:06.049+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:06.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:06.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:06.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:06.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:06.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:06.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:06.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:06.322+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:06.677 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:06.322+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:06.677 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:06.322+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:07.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:06.780+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:07.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:06 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:06.780+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:07.159 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:06.850+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:07.159 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:06.850+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:07.160 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:06 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:06.850+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:07.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:06.798+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.517189+0000 front 2024-09-21T07:09:25.517399+0000 (oldest deadline 2024-09-21T07:09:50.717701+0000) 2024-09-21T07:10:07.269 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:06.798+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.018591+0000 front 2024-09-21T07:09:33.018706+0000 (oldest deadline 2024-09-21T07:09:58.918460+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5[45120]: 2024-09-21T07:10:06.798+0000 7f800d6bd640 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:38.918782+0000 front 2024-09-21T07:09:38.918857+0000 (oldest deadline 2024-09-21T07:10:04.818918+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:07.009+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:07.009+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:07.009+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:06.818+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:06.818+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:07.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:06 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:06.818+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:07.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:07.156+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:07.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:07.156+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:07.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:07.156+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:07.743 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:07 smithi181 podman[66227]: 2024-09-21 07:10:07.442567099 +0000 UTC m=+5.531176923 container died d4659c8d4891a7e806cf265a98657f06d3206eebe63cf612e5e42a391a09fb5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:10:07.805 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:07 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:07.356+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:07.805 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:07 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:07.356+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:07.806 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:07 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:07.356+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:08.019 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:07 smithi181 podman[66227]: 2024-09-21 07:10:07.841681493 +0000 UTC m=+5.930291309 container cleanup d4659c8d4891a7e806cf265a98657f06d3206eebe63cf612e5e42a391a09fb5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:08.020 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:07 smithi181 bash[66227]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5 2024-09-21T07:10:08.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:07.867+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:08.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:07.867+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:08.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:07 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:07.867+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:08.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:07 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:07.803+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:08.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:07 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:07.803+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:08.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:07.864+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:08.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:07.864+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:08.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:07 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:07.864+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:08.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:08.112+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:08.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:08.112+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:08.299 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:08.112+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:08.454 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66243]: 2024-09-21 07:10:08.10172684 +0000 UTC m=+0.659599840 container remove d4659c8d4891a7e806cf265a98657f06d3206eebe63cf612e5e42a391a09fb5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:08.454 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:08.022+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:08.454 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:08.022+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:08.454 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:08.022+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:08.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:08 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:08.349+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:08.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:08 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:08.349+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:08.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:08 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:08.349+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:08.706 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.355693516 +0000 UTC m=+0.015449943 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:08.706 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.460762152 +0000 UTC m=+0.120518568 container create d158d4eea64c08d129cb783b99c64e7ae8596d7a68f54b5b61ccaed68588bd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T07:10:09.019 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:08.871+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:08.871+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:08 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:08.871+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.705087697 +0000 UTC m=+0.364844112 container init d158d4eea64c08d129cb783b99c64e7ae8596d7a68f54b5b61ccaed68588bd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.708479544 +0000 UTC m=+0.368235961 container start d158d4eea64c08d129cb783b99c64e7ae8596d7a68f54b5b61ccaed68588bd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.805006132 +0000 UTC m=+0.464762568 container attach d158d4eea64c08d129cb783b99c64e7ae8596d7a68f54b5b61ccaed68588bd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:10:09.020 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 07:10:08 smithi181 podman[66332]: 2024-09-21 07:10:08.905043785 +0000 UTC m=+0.564800214 container died d158d4eea64c08d129cb783b99c64e7ae8596d7a68f54b5b61ccaed68588bd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T07:10:09.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:08 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:08.820+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:09.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:08 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:08.820+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:09.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:08.880+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:09.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:08.880+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:09.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:08.880+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:09.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:09.068+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:09.299 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:09.068+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:09.299 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:09.068+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:09.502 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.023+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:09.502 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.023+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:09.502 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.023+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:09.528 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T07:10:09.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:09.570 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T07:10:09.570 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T07:10:09.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.6 2024-09-21T07:10:09.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:09 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:09.336+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:09.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:09 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:09.336+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:09.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:09 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:09.336+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:09.912 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 systemd[1]: Stopping Ceph osd.6 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:09.912 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.834+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:09.912 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.834+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:09.912 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.834+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:10.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:09 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:09.799+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:10.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:09 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:09.799+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:10.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:09.905+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:10.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:09.905+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:10.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:09.905+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:10.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.980+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:10.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.980+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:10.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:09 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:09.980+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.909+0000 7f2230473640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.909+0000 7f2230473640 -1 osd.6 77 *** Got signal Terminated *** 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:09 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:09.909+0000 7f2230473640 -1 osd.6 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:10.051+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:10.051+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:10.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:10.051+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:10.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:10.328+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:10.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:10.328+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:10.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:10.328+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:11.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:10.806+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:11.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:10 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:10.806+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:11.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:10.993+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:11.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:10.993+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:11.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:10.993+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:11.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:10.916+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:11.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:10.916+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:11.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:10 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:10.916+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:11.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:11.026+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:11.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:11.026+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:11.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:11.026+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:11.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:10.832+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:11.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:10.832+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:11.299 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:10 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:10.832+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:11.830 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:11 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:11.363+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:11.830 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:11 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:11.363+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:11.830 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:11 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:11.363+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:12.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:11 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:11.828+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:12.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:11 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:11.828+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:12.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:11.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:12.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:11.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:12.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:11.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:12.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:11.956+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:12.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:11.956+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:12.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:11 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:11.956+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:11.875+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:11.875+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:11 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:11.875+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:12.011+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:12.011+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:12.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:12.011+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:12.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:12 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:12.379+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:12.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:12 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:12.379+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:12.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:12 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:12.379+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:13.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:12 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:12.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:13.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:12 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:12.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:13.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:12 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:12.988+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:13.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:13.001+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:13.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:13.001+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:13.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:13.001+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:12.894+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:12.894+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:12 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:12.894+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:13.053+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:13.053+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:13.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:13.053+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:13.356 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:12 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:12.874+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:13.357 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:12 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:12.874+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:13.829 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:13.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:13.829 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:13.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:13.829 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:13.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:14.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:13.828+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:14.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:13.828+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:14.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:13.987+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:14.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:13.987+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:14.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:13 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:13.987+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:14.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:14.044+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:14.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:14.044+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:14.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:14.044+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:14.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:13.887+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:14.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:13.887+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:14.298 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:13 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:13.887+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:14.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:14.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:14.299 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:14.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:14.299 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:14.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:14.819 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:14.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:14.819 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:14.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:14.819 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:14.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:15.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:14.817+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:15.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:14.817+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:15.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:14 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:14.817+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:15.146 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:14.843+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.220968+0000 front 2024-09-21T07:09:25.221014+0000 (oldest deadline 2024-09-21T07:09:50.521152+0000) 2024-09-21T07:10:15.146 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:14.843+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:30.521672+0000 front 2024-09-21T07:09:30.521808+0000 (oldest deadline 2024-09-21T07:09:55.221761+0000) 2024-09-21T07:10:15.146 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:14 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6[59476]: 2024-09-21T07:10:14.843+0000 7f222ca5e640 -1 osd.6 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:39.823548+0000 front 2024-09-21T07:09:39.823417+0000 (oldest deadline 2024-09-21T07:10:03.923453+0000) 2024-09-21T07:10:15.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:15.018+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:15.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:15.018+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:15.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:15.018+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:15.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:14.975+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:15.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:14.975+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:15.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:14 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:14.975+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:15.497 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:15 smithi028 podman[86056]: 2024-09-21 07:10:15.265854794 +0000 UTC m=+5.494752538 container died 83be68012774e88b6120b872add96d5a714b13ea5ce21076e7373ee8585130a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T07:10:15.497 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:15.144+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:15.498 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:15.144+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:15.498 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:15.144+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:15.498 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:15 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:15.144+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:15.801 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:15.433+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:15.801 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:15.433+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:15.802 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:15.433+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:16.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:15 smithi028 podman[86056]: 2024-09-21 07:10:15.785491199 +0000 UTC m=+6.014388921 container cleanup 83be68012774e88b6120b872add96d5a714b13ea5ce21076e7373ee8585130a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:16.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:15 smithi028 bash[86056]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6 2024-09-21T07:10:16.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:15 smithi028 podman[86072]: 2024-09-21 07:10:15.987019693 +0000 UTC m=+0.710698830 container remove 83be68012774e88b6120b872add96d5a714b13ea5ce21076e7373ee8585130a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-21T07:10:16.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:15.800+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:16.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:15.800+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:16.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:15 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:15.800+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:16.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:15.989+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:16.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:15.989+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:16.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:15 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:15.989+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:16.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.003+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:16.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.003+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:16.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.003+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:16.430 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:16 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:16.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:16.430 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:16 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:16.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:16.430 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:16 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:16.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:16.430 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:16 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:16.143+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:16.724 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.429345853 +0000 UTC m=+0.115686095 container create 1d88cf7fedc817a86293ce51bbebad01a8304fd1aca235d4d1cb81f254826f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:16.724 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.333409449 +0000 UTC m=+0.019749703 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:16.725 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.64896484 +0000 UTC m=+0.335305094 container init 1d88cf7fedc817a86293ce51bbebad01a8304fd1aca235d4d1cb81f254826f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:10:16.725 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.652813406 +0000 UTC m=+0.339153654 container start 1d88cf7fedc817a86293ce51bbebad01a8304fd1aca235d4d1cb81f254826f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:16.725 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.72363954 +0000 UTC m=+0.409979783 container attach 1d88cf7fedc817a86293ce51bbebad01a8304fd1aca235d4d1cb81f254826f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T07:10:16.769 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:16.446+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:16.769 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:16.446+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:16.770 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:16.446+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:16.770 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:16.446+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:17.048 INFO:journalctl@ceph.osd.6.smithi028.stdout:Sep 21 07:10:16 smithi028 podman[86173]: 2024-09-21 07:10:16.853344977 +0000 UTC m=+0.539685227 container died 1d88cf7fedc817a86293ce51bbebad01a8304fd1aca235d4d1cb81f254826f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:17.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:16.768+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:17.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:16.768+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:17.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:16 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:16.768+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:17.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:16.950+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:17.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:16.950+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:17.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:16.950+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:17.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:17.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:17.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:16 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:16.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:17.520 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:17 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:17.102+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:17.520 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:17 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:17.102+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:17.521 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:17 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:17.102+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:17.521 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:17 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:17.102+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:17.541 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T07:10:17.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:17.590 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T07:10:17.590 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T07:10:17.590 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.7 2024-09-21T07:10:17.740 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 systemd[1]: Stopping Ceph osd.7 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:17.741 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:17.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:17.741 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:17.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:17.741 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:17.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:17.741 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:17.453+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:18.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.738+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:18.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.738+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:18.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.738+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:18.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.906+0000 7f9dbb4b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:18.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.906+0000 7f9dbb4b1640 -1 osd.7 77 *** Got signal Terminated *** 2024-09-21T07:10:18.107 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:17 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:17.906+0000 7f9dbb4b1640 -1 osd.7 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:18.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:17.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:18.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:17.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:18.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:17.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:18.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:17.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:18.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:17.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:18.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:17 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:17.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:18.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:18 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:18.130+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:18.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:18 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:18.130+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:18.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:18 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:18.130+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:18.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:18 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:18.130+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:18.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:18.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:18.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:18.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:18.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:18.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:18.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:18.472+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:18.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:18.472+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:18.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:18.472+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:18.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:18.472+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:19.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:18.894+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:19.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:18.894+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:19.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:18.894+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:19.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:18.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:19.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:18.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:19.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:18 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:18.979+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:19.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:19 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:19.154+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:19.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:19 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:19.154+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:19.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:19 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:19.154+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:19.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:19 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:19.154+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:19.671+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:19.671+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:19.671+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:19.517+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:19.517+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:19.517+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:19.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:19 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:19.517+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:20.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:19.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:20.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:19.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:20.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:19.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:20.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:19.954+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:20.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:19.954+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:20.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:19 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:19.954+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:20.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:20.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:20.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:20.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:20.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:20.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:20.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:20.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:20.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:20 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:20.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:20.856 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:20.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:20.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:20.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:20.714+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.035985+0000 front 2024-09-21T07:09:58.035918+0000 (oldest deadline 2024-09-21T07:10:20.335938+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:20.522+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:20.522+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:20.522+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:20.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:20 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:20.522+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:21.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:20.918+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:21.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:20.918+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:21.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:20.918+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:21.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:20.889+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:21.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:20.889+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:21.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:20.889+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:21.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:20 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:20.889+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:21.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:21.110+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:21.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:21.110+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:21.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:21.110+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:21.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:21.110+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:21.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:21 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:21.110+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:21.856 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:21.729+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:21.729+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:21.729+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:21.729+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.035985+0000 front 2024-09-21T07:09:58.035918+0000 (oldest deadline 2024-09-21T07:10:20.335938+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:21.503+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:21.503+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:21.503+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:21.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:21 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:21.503+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:22.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:21.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:22.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:21.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:22.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:21.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:22.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:21.922+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:22.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:21.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:22.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:21.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:22.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:21 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:21.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:22.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:22.098+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:22.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:22.098+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:22.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:22.098+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:22.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:22.098+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:22.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:22 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:22.098+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:22.753+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.632466+0000 front 2024-09-21T07:09:31.632511+0000 (oldest deadline 2024-09-21T07:09:57.532788+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:22.753+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.433867+0000 front 2024-09-21T07:09:40.434166+0000 (oldest deadline 2024-09-21T07:10:05.733900+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:22.753+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:48.635169+0000 front 2024-09-21T07:09:48.635224+0000 (oldest deadline 2024-09-21T07:10:13.935038+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7[51643]: 2024-09-21T07:10:22.753+0000 7f9db3a94640 -1 osd.7 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.035985+0000 front 2024-09-21T07:09:58.035918+0000 (oldest deadline 2024-09-21T07:10:20.335938+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:22.510+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:22.510+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:22.510+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:22.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:22 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:22.510+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:23.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:22.904+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:22.904+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:22.904+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:22.904+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:22.900+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:22.900+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:23.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:22.900+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:23.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:22 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:22.900+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:23.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:23 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:23.069+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:23.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:23 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:23.069+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:23.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:23 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:23.069+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:23.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:23 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:23.069+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:23.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:23 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:23.069+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:23.606 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:23 smithi129 podman[66646]: 2024-09-21 07:10:23.264417975 +0000 UTC m=+5.483080181 container died f4d1ac6309dd73943507d1f1d9bcbb354f504f2052cdd9c91f8d0c3c2a7f6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:10:23.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:23.508+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:23.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:23.508+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:23.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:23.508+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:23.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:23.508+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:23.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:23.508+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:23.933 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:23 smithi129 podman[66646]: 2024-09-21 07:10:23.705888595 +0000 UTC m=+5.924550806 container cleanup f4d1ac6309dd73943507d1f1d9bcbb354f504f2052cdd9c91f8d0c3c2a7f6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:10:23.933 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:23 smithi129 bash[66646]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7 2024-09-21T07:10:24.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:23.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:23.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:23.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:23.935+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:23.919+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:23.919+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:23.919+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:24.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:23 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:23.919+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:24.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:24 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:24.031+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:24.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:24 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:24.031+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:24.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:24 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:24.031+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:24.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:24 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:24.031+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:24.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:24 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:24.031+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:24.356 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:23 smithi129 podman[66661]: 2024-09-21 07:10:23.932089214 +0000 UTC m=+0.660406691 container remove f4d1ac6309dd73943507d1f1d9bcbb354f504f2052cdd9c91f8d0c3c2a7f6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.358019715 +0000 UTC m=+0.103782411 container create 1ccfa4247409ebabacebab0f4351c9b954e63d6732443d934791f4bf6ccc19ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.270375831 +0000 UTC m=+0.016138525 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.602130467 +0000 UTC m=+0.347893169 container init 1ccfa4247409ebabacebab0f4351c9b954e63d6732443d934791f4bf6ccc19ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.606003055 +0000 UTC m=+0.351765757 container start 1ccfa4247409ebabacebab0f4351c9b954e63d6732443d934791f4bf6ccc19ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.702078419 +0000 UTC m=+0.447841116 container attach 1ccfa4247409ebabacebab0f4351c9b954e63d6732443d934791f4bf6ccc19ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:24.703 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:24 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:24.462+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:24.704 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:24 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:24.462+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:24.704 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:24 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:24.462+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:24.704 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:24 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:24.462+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:24.704 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:24 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:24.462+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:25.106 INFO:journalctl@ceph.osd.7.smithi129.stdout:Sep 21 07:10:24 smithi129 podman[66749]: 2024-09-21 07:10:24.795805456 +0000 UTC m=+0.541568150 container died 1ccfa4247409ebabacebab0f4351c9b954e63d6732443d934791f4bf6ccc19ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T07:10:25.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:24.981+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:24.981+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:24.981+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:24.981+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:24.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:24.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:24.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:25.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:24 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:24.946+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:25.439 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T07:10:25.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:25.482 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T07:10:25.482 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T07:10:25.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.8 2024-09-21T07:10:25.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:25 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:25.062+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:25.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:25 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:25.062+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:25.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:25 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:25.062+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:25.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:25 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:25.062+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:25.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:25 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:25.062+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:25.695 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:25 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:25.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:25.695 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:25 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:25.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:25.695 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:25 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:25.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:25.695 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:25 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:25.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:25.695 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:25 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:25.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:25.770 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 systemd[1]: Stopping Ceph osd.8 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:26.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.794+0000 7f00ef087640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.794+0000 7f00ef087640 -1 osd.8 77 *** Got signal Terminated *** 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.794+0000 7f00ef087640 -1 osd.8 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.951+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.951+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.951+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:25.951+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:25.921+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:25.921+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:25.921+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:26.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:25 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:25.921+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:26.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:26.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:26.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:26.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:26.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:26.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:26.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:26.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:26.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:26 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:26.097+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:26.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:26 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:26.466+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:26.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:26 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:26.466+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:26.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:26 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:26.466+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:26.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:26 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:26.466+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:26.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:26 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:26.466+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:27.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:26.996+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:26.996+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:26.996+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:26.996+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:26.894+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:26.894+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:27.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:26.894+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:27.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:26 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:26.894+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:27.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:27.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:27.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:27.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:27.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:27.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:27.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:27.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:27.298 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:27 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:27.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:27.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:27.512+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:27.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:27.512+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:27.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:27.512+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:27.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:27.512+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:27.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:27.512+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:28.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:27.943+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:27.943+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:27.943+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:27.943+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:27.985+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:27.985+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:27.985+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:27.985+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:28.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:27 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:27.985+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:03.478589+0000 front 2024-09-21T07:10:03.478616+0000 (oldest deadline 2024-09-21T07:10:27.578776+0000) 2024-09-21T07:10:28.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:28 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:28.090+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:28.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:28 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:28.090+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:28.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:28 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:28.090+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:28.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:28 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:28.090+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:28.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:28 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:28.090+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:28.758 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:28 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:28.463+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:29.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:28.949+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:29.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:28.949+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:29.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:28.949+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:29.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:28.949+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:29.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:28.949+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:03.478589+0000 front 2024-09-21T07:10:03.478616+0000 (oldest deadline 2024-09-21T07:10:27.578776+0000) 2024-09-21T07:10:29.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:28.930+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:29.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:28.930+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:29.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:28.930+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:29.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:28 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:28.930+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:29.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:29.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:29.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:29.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:29.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:29.549 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:29 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:29.100+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:29.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:29.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:29.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:29.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:29.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:29.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:29 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:29.425+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:30.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:29.925+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:24.071114+0000 front 2024-09-21T07:09:24.071028+0000 (oldest deadline 2024-09-21T07:09:46.970979+0000) 2024-09-21T07:10:30.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:29.925+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:32.173222+0000 front 2024-09-21T07:09:32.173179+0000 (oldest deadline 2024-09-21T07:09:57.973434+0000) 2024-09-21T07:10:30.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:29.925+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.374862+0000 front 2024-09-21T07:09:41.374999+0000 (oldest deadline 2024-09-21T07:10:03.675122+0000) 2024-09-21T07:10:30.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:29.925+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:54.077861+0000 front 2024-09-21T07:09:54.077934+0000 (oldest deadline 2024-09-21T07:10:19.977740+0000) 2024-09-21T07:10:30.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8[51719]: 2024-09-21T07:10:29.925+0000 7f00eb672640 -1 osd.8 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:03.478589+0000 front 2024-09-21T07:10:03.478616+0000 (oldest deadline 2024-09-21T07:10:27.578776+0000) 2024-09-21T07:10:30.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:29.953+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:30.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:29.953+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:30.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:29.953+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:30.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:29.953+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:30.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:30 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:30.133+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:30.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:30 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:30.399+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:31.269 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:31 smithi181 podman[66435]: 2024-09-21 07:10:31.138889892 +0000 UTC m=+5.458665865 container died f6a8875ad104a2f965856073a5299d90aba2eb97159a63a1d1403181391a4605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:31.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:30 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:30.932+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:31.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:30 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:30.932+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:31.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:30 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:30.932+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:31.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:30 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:30.932+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:31.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:31 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:31.147+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:31.763 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:31 smithi181 podman[66435]: 2024-09-21 07:10:31.50287664 +0000 UTC m=+5.822652613 container cleanup f6a8875ad104a2f965856073a5299d90aba2eb97159a63a1d1403181391a4605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:10:31.763 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:31 smithi181 bash[66435]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:31.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:31 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:31.449+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:32.019 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:31 smithi181 podman[66450]: 2024-09-21 07:10:31.762733762 +0000 UTC m=+0.624911046 container remove f6a8875ad104a2f965856073a5299d90aba2eb97159a63a1d1403181391a4605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:32.019 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:31 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:31.926+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:32.019 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:31 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:31.926+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:32.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:31 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:31.926+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:32.020 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:31 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:31.926+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:32.392 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.019296218 +0000 UTC m=+0.015460678 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:32.392 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.146909818 +0000 UTC m=+0.143074313 container create 4554931198f33259741995807d0dbbad10a92c1720b70eb6d5a0e2aebad98c97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T07:10:32.392 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.391048426 +0000 UTC m=+0.387212885 container init 4554931198f33259741995807d0dbbad10a92c1720b70eb6d5a0e2aebad98c97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:32.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:32 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:32.180+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:32.769 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.394600353 +0000 UTC m=+0.390764803 container start 4554931198f33259741995807d0dbbad10a92c1720b70eb6d5a0e2aebad98c97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:10:32.769 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.474262146 +0000 UTC m=+0.470426605 container attach 4554931198f33259741995807d0dbbad10a92c1720b70eb6d5a0e2aebad98c97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:32.770 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 07:10:32 smithi181 podman[66543]: 2024-09-21 07:10:32.577950384 +0000 UTC m=+0.574114834 container died 4554931198f33259741995807d0dbbad10a92c1720b70eb6d5a0e2aebad98c97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:32.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:32.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:32.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:32.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:32.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:32.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:32 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:32.437+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:33.220 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:32 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:32.915+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:33.221 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:32 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:32.915+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:33.221 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:32 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:32.915+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:33.221 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:32 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:32.915+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:33.221 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:32 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:32.915+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:33.249 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T07:10:33.289 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:33.290 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T07:10:33.290 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T07:10:33.290 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.9 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.199+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:33.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 systemd[1]: Stopping Ceph osd.9 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:33.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:33.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:33.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:33.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:33.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:33.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:33 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:33.417+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:34.048 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.580+0000 7fe7f91ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:34.048 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.580+0000 7fe7f91ee640 -1 osd.9 77 *** Got signal Terminated *** 2024-09-21T07:10:34.048 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:33 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:33.580+0000 7fe7f91ee640 -1 osd.9 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:34.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:33 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:33.913+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:34.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:33 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:33.913+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:34.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:33 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:33.913+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:34.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:33 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:33.913+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:34.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:33 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:33.913+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:34.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:34 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:34.157+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:34.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:34.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:34.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:34.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:34.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:34.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:34 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:34.428+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:35.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:34 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:34.906+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:35.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:34 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:34.906+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:35.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:34 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:34.906+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:35.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:34 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:34.906+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:35.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:34 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:34.906+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:35.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:35 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:35.160+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:35.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:35.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:35.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:35.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:35.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:35.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:35 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:35.465+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:36.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:35.925+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:36.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:35.925+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:36.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:35.925+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:36.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:35.925+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:36.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:35.925+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:36.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:36 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:36.138+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:36.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:36.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:36.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:36.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:36.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:36.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:36 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:36.445+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:37.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:36 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:36.950+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:37.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:36 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:36.950+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:37.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:36 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:36.950+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:37.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:36 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:36.950+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:37.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:36 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:36.950+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:37.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:37.626 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:37.626 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:37.626 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:37.626 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:37.626 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:37 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:37.158+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:37.858 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:37 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:37.461+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:38.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:37.989+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:38.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:37.989+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:38.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:37.989+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:38.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:37.989+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:38.271 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:37 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:37.989+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:25.712234+0000 front 2024-09-21T07:09:25.712334+0000 (oldest deadline 2024-09-21T07:09:47.412295+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:31.513771+0000 front 2024-09-21T07:09:31.513653+0000 (oldest deadline 2024-09-21T07:09:57.413494+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:37.414165+0000 front 2024-09-21T07:09:37.414205+0000 (oldest deadline 2024-09-21T07:10:03.313893+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.414795+0000 front 2024-09-21T07:09:47.414775+0000 (oldest deadline 2024-09-21T07:10:14.415605+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:58.918334+0000 front 2024-09-21T07:09:58.918310+0000 (oldest deadline 2024-09-21T07:10:20.018436+0000) 2024-09-21T07:10:38.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9[66118]: 2024-09-21T07:10:38.194+0000 7fe7f57d9640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:02.919490+0000 front 2024-09-21T07:10:02.919542+0000 (oldest deadline 2024-09-21T07:10:28.219410+0000) 2024-09-21T07:10:38.812 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:38.812 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:38.813 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:38.813 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:38.813 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:38.813 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:38.813 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:38 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:38.443+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:39.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:38 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:38.968+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:39.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:38 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:38.968+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:39.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:38 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:38.968+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:39.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:38 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:38.968+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:39.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:38 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:38.968+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:39.273 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:38 smithi028 podman[86276]: 2024-09-21 07:10:38.904972202 +0000 UTC m=+5.411099227 container died 207c6058e76deef097fdb08cb80228b58698257991adfbd8d62813e1d3b7feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T07:10:39.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:39 smithi028 podman[86276]: 2024-09-21 07:10:39.437774267 +0000 UTC m=+5.943901284 container cleanup 207c6058e76deef097fdb08cb80228b58698257991adfbd8d62813e1d3b7feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T07:10:39.548 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:39 smithi028 bash[86276]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9 2024-09-21T07:10:39.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:39.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:39 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:39.441+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:40.048 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:39 smithi028 podman[86292]: 2024-09-21 07:10:39.664351972 +0000 UTC m=+0.757107458 container remove 207c6058e76deef097fdb08cb80228b58698257991adfbd8d62813e1d3b7feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T07:10:40.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:40.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:40.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:40.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:40.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:40.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.006+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:40.385 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.020493314 +0000 UTC m=+0.016100408 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:40.385 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.148358775 +0000 UTC m=+0.143965859 container create 29a809de3f7be99d2327d9721101762633e158a276401008168c6e5672739857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T07:10:40.385 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.38385379 +0000 UTC m=+0.379460879 container init 29a809de3f7be99d2327d9721101762633e158a276401008168c6e5672739857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T07:10:40.798 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.387634502 +0000 UTC m=+0.383241590 container start 29a809de3f7be99d2327d9721101762633e158a276401008168c6e5672739857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:10:40.798 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.458801269 +0000 UTC m=+0.454408362 container attach 29a809de3f7be99d2327d9721101762633e158a276401008168c6e5672739857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:10:40.798 INFO:journalctl@ceph.osd.9.smithi028.stdout:Sep 21 07:10:40 smithi028 podman[86381]: 2024-09-21 07:10:40.582232488 +0000 UTC m=+0.577839581 container died 29a809de3f7be99d2327d9721101762633e158a276401008168c6e5672739857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:40.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:40 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:40.393+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:41.258 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T07:10:41.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:41.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:41.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:41.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:41.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:41.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:40 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:40.998+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:41.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:41.302 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T07:10:41.302 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T07:10:41.302 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.10 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 systemd[1]: Stopping Ceph osd.10 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:41.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.422+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:42.106 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.616+0000 7f564fadb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:42.107 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.616+0000 7f564fadb640 -1 osd.10 77 *** Got signal Terminated *** 2024-09-21T07:10:42.107 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:41 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:41.616+0000 7f564fadb640 -1 osd.10 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:42.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:42.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:42.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:42.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:42.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:42.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:42 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:42.009+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:42.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:42 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:42.389+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:43.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:43.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:43.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:43.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:43.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:43.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:43.008+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:43.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:43 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:43.354+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:44.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:44.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:44.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:44.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:44.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:44.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.026+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:44.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:44.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:44 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:44.403+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:45.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:45.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:45.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:45.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:45.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:45.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:44 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:44.982+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:45.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:45 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:45.404+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:46.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:46.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:46 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:45.999+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:46.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:26.250932+0000 front 2024-09-21T07:09:26.250706+0000 (oldest deadline 2024-09-21T07:09:47.950888+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:34.253067+0000 front 2024-09-21T07:09:34.253025+0000 (oldest deadline 2024-09-21T07:09:56.553235+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:41.854569+0000 front 2024-09-21T07:09:41.854628+0000 (oldest deadline 2024-09-21T07:10:04.154305+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-09-21T07:09:47.655695+0000 front 2024-09-21T07:09:47.655625+0000 (oldest deadline 2024-09-21T07:10:15.855883+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:57.457201+0000 front 2024-09-21T07:09:57.457158+0000 (oldest deadline 2024-09-21T07:10:22.757242+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.858414+0000 front 2024-09-21T07:10:06.858323+0000 (oldest deadline 2024-09-21T07:10:27.958127+0000) 2024-09-21T07:10:46.857 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10[58342]: 2024-09-21T07:10:46.419+0000 7f56480be640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:12.559744+0000 front 2024-09-21T07:10:12.559727+0000 (oldest deadline 2024-09-21T07:10:36.659479+0000) 2024-09-21T07:10:47.192 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:46 smithi129 podman[66864]: 2024-09-21 07:10:46.927960959 +0000 UTC m=+5.427780821 container died 30870fd073517239a08e95ec4b0b8c215bb3fa2d728f321308fb8d5ded0d80ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:10:47.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:47.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:47.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:47.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:47.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:47.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:47.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:47 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:47.043+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:47.551 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:47 smithi129 podman[66864]: 2024-09-21 07:10:47.290872493 +0000 UTC m=+5.790692344 container cleanup 30870fd073517239a08e95ec4b0b8c215bb3fa2d728f321308fb8d5ded0d80ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T07:10:47.552 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:47 smithi129 bash[66864]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10 2024-09-21T07:10:47.856 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:47 smithi129 podman[66880]: 2024-09-21 07:10:47.550380519 +0000 UTC m=+0.622749864 container remove 30870fd073517239a08e95ec4b0b8c215bb3fa2d728f321308fb8d5ded0d80ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T07:10:48.171 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:47 smithi129 podman[66973]: 2024-09-21 07:10:47.811648635 +0000 UTC m=+0.016032239 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:48.171 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:47 smithi129 podman[66973]: 2024-09-21 07:10:47.909567348 +0000 UTC m=+0.113950939 container create 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:48.171 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:48 smithi129 podman[66973]: 2024-09-21 07:10:48.170267612 +0000 UTC m=+0.374651204 container init 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:10:48.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:48.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:48 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:48.031+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:48.606 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:48 smithi129 podman[66973]: 2024-09-21 07:10:48.173900546 +0000 UTC m=+0.378284140 container start 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T07:10:48.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:48 smithi129 podman[66973]: 2024-09-21 07:10:48.253528944 +0000 UTC m=+0.457912558 container attach 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:48.607 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:48 smithi129 podman[66973]: 2024-09-21 07:10:48.368002113 +0000 UTC m=+0.572385717 container died 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T07:10:48.918 INFO:journalctl@ceph.osd.10.smithi129.stdout:Sep 21 07:10:48 smithi129 podman[66996]: 2024-09-21 07:10:48.898472236 +0000 UTC m=+0.523821015 container remove 78a2e2559b27aaa01d3e1ede70b1cfc9b7e74171c0b85579061458b46a986232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T07:10:48.923 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T07:10:48.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:48.961 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T07:10:48.961 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T07:10:48.962 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.11 2024-09-21T07:10:49.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 systemd[1]: Stopping Ceph osd.11 for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:49.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:49.269 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:49.270 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.063+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:49.769 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.271+0000 7f36b6db9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:49.769 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.271+0000 7f36b6db9640 -1 osd.11 77 *** Got signal Terminated *** 2024-09-21T07:10:49.769 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:49 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:49.271+0000 7f36b6db9640 -1 osd.11 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:10:50.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:50.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:50.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:50.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:50.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:50.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:50.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:50 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:50.029+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:51.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:51.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:51 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:51.038+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:52.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:52.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:52.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:52.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:52.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:52.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:52.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:52 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:52.061+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:53.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:53.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:53.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:53.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:53.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:53.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:53.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:53 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:53.070+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:54.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-09-21T07:09:23.590145+0000 front 2024-09-21T07:09:23.590036+0000 (oldest deadline 2024-09-21T07:09:47.690174+0000) 2024-09-21T07:10:54.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6804 osd.1 since back 2024-09-21T07:09:33.591288+0000 front 2024-09-21T07:09:33.591474+0000 (oldest deadline 2024-09-21T07:09:56.391809+0000) 2024-09-21T07:10:54.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T07:09:40.993501+0000 front 2024-09-21T07:09:40.993340+0000 (oldest deadline 2024-09-21T07:10:04.493587+0000) 2024-09-21T07:10:54.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6812 osd.4 since back 2024-09-21T07:09:56.796064+0000 front 2024-09-21T07:09:56.796018+0000 (oldest deadline 2024-09-21T07:10:22.696066+0000) 2024-09-21T07:10:54.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T07:10:06.196955+0000 front 2024-09-21T07:10:06.196976+0000 (oldest deadline 2024-09-21T07:10:32.097218+0000) 2024-09-21T07:10:54.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-09-21T07:10:13.198162+0000 front 2024-09-21T07:10:13.198196+0000 (oldest deadline 2024-09-21T07:10:39.098013+0000) 2024-09-21T07:10:54.520 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11[58221]: 2024-09-21T07:10:54.069+0000 7f36af39c640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.129:6820 osd.7 since back 2024-09-21T07:10:21.899383+0000 front 2024-09-21T07:10:21.899319+0000 (oldest deadline 2024-09-21T07:10:45.999200+0000) 2024-09-21T07:10:54.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 podman[66657]: 2024-09-21 07:10:54.612488992 +0000 UTC m=+5.457227115 container died 1ebd3ab3b177191a7ef4dc2a36c2f2ae4aa4c51792eabfe6910fbb4fbaa90d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:55.224 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 podman[66657]: 2024-09-21 07:10:54.971467484 +0000 UTC m=+5.816205593 container cleanup 1ebd3ab3b177191a7ef4dc2a36c2f2ae4aa4c51792eabfe6910fbb4fbaa90d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:55.224 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:54 smithi181 bash[66657]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11 2024-09-21T07:10:55.519 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66672]: 2024-09-21 07:10:55.222652834 +0000 UTC m=+0.608692586 container remove 1ebd3ab3b177191a7ef4dc2a36c2f2ae4aa4c51792eabfe6910fbb4fbaa90d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:55.827 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.44099538 +0000 UTC m=+0.015787545 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:55.827 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.540027326 +0000 UTC m=+0.114819484 container create 74a4e330e88b18910dda3e8d27c19c39e1a8e15b3cb5485117ae1354849a8eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T07:10:55.827 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.75100377 +0000 UTC m=+0.325795927 container init 74a4e330e88b18910dda3e8d27c19c39e1a8e15b3cb5485117ae1354849a8eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:10:55.827 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.754301596 +0000 UTC m=+0.329093754 container start 74a4e330e88b18910dda3e8d27c19c39e1a8e15b3cb5485117ae1354849a8eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:55.827 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.825823811 +0000 UTC m=+0.400615974 container attach 74a4e330e88b18910dda3e8d27c19c39e1a8e15b3cb5485117ae1354849a8eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:56.238 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 07:10:55 smithi181 podman[66761]: 2024-09-21 07:10:55.945921708 +0000 UTC m=+0.520713872 container died 74a4e330e88b18910dda3e8d27c19c39e1a8e15b3cb5485117ae1354849a8eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:10:56.515 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T07:10:56.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:56.553 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T07:10:56.554 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T07:10:56.554 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.a 2024-09-21T07:10:56.869 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:56 smithi028 systemd[1]: Stopping Ceph mds.a for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:57.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: 2024-09-21T07:10:56.864+0000 7f8b9a098640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:57.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:56 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a[72473]: 2024-09-21T07:10:56.864+0000 7f8b9a098640 -1 mds.a *** got signal Terminated *** 2024-09-21T07:10:58.298 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:58 smithi028 podman[86498]: 2024-09-21 07:10:58.041459064 +0000 UTC m=+1.278451936 container died 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T07:10:58.792 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:58 smithi028 podman[86498]: 2024-09-21 07:10:58.506282291 +0000 UTC m=+1.743275153 container cleanup 97d9facfd82914ddf9453c0300289fe5e3c71860f649ef96bb56c286bab73d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T07:10:58.792 INFO:journalctl@ceph.mds.a.smithi028.stdout:Sep 21 07:10:58 smithi028 bash[86498]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-a 2024-09-21T07:10:58.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T07:10:58.981 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:10:58.982 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T07:10:58.982 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T07:10:58.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.d 2024-09-21T07:10:59.298 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:10:59 smithi028 systemd[1]: Stopping Ceph mds.d for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:10:59.798 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:10:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d[71362]: 2024-09-21T07:10:59.318+0000 7fab88fae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:10:59.798 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:10:59 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d[71362]: 2024-09-21T07:10:59.318+0000 7fab88fae640 -1 mds.d *** got signal Terminated *** 2024-09-21T07:11:03.548 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:11:03 smithi028 podman[86621]: 2024-09-21 07:11:03.3307702 +0000 UTC m=+4.116139831 container died b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T07:11:04.170 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:11:03 smithi028 podman[86621]: 2024-09-21 07:11:03.885141447 +0000 UTC m=+4.670511104 container cleanup b6353830e6452e7397e7779c9ec97b70e1e14e9acf275606e5cfb303d7ed9daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T07:11:04.171 INFO:journalctl@ceph.mds.d.smithi028.stdout:Sep 21 07:11:03 smithi028 bash[86621]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-d 2024-09-21T07:11:04.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T07:11:04.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:04.360 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T07:11:04.360 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T07:11:04.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.g 2024-09-21T07:11:04.682 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:04 smithi028 systemd[1]: Stopping Ceph mds.g for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:05.048 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-g[72121]: 2024-09-21T07:11:04.681+0000 7fbf982f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:05.048 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:04 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-g[72121]: 2024-09-21T07:11:04.681+0000 7fbf982f8640 -1 mds.g *** got signal Terminated *** 2024-09-21T07:11:07.933 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:07 smithi028 podman[86742]: 2024-09-21 07:11:07.639733389 +0000 UTC m=+3.053272093 container died 9d5d12c0511af5b904b6e618c7d652c1b32a33d6153d6e39bd065929fa488e16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:11:08.298 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:08 smithi028 podman[86742]: 2024-09-21 07:11:08.097270177 +0000 UTC m=+3.510808909 container cleanup 9d5d12c0511af5b904b6e618c7d652c1b32a33d6153d6e39bd065929fa488e16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:11:08.298 INFO:journalctl@ceph.mds.g.smithi028.stdout:Sep 21 07:11:08 smithi028 bash[86742]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-g 2024-09-21T07:11:08.526 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T07:11:08.559 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:08.559 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T07:11:08.560 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T07:11:08.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.j 2024-09-21T07:11:09.048 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:08 smithi028 systemd[1]: Stopping Ceph mds.j for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:09.048 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j[70990]: 2024-09-21T07:11:08.867+0000 7f0a332cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:09.048 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:08 smithi028 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j[70990]: 2024-09-21T07:11:08.867+0000 7f0a332cb640 -1 mds.j *** got signal Terminated *** 2024-09-21T07:11:12.548 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:12 smithi028 podman[86862]: 2024-09-21 07:11:12.281096522 +0000 UTC m=+3.491882563 container died d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:11:13.023 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:12 smithi028 podman[86862]: 2024-09-21 07:11:12.609345327 +0000 UTC m=+3.820131408 container cleanup d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:11:13.023 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:12 smithi028 bash[86862]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j 2024-09-21T07:11:13.023 INFO:journalctl@ceph.mds.j.smithi028.stdout:Sep 21 07:11:12 smithi028 podman[86874]: 2024-09-21 07:11:12.810407184 +0000 UTC m=+0.521898561 container remove d94c7f1bf0e1e50f5712b743f8b33cc7cf26a33a1856a2b333935ec8534fae9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:11:13.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T07:11:13.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:13.066 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T07:11:13.066 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T07:11:13.067 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.b 2024-09-21T07:11:13.356 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:13 smithi129 systemd[1]: Stopping Ceph mds.b for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:13.611 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: 2024-09-21T07:11:13.373+0000 7f6ffe7ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:13.611 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:13 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b[63642]: 2024-09-21T07:11:13.373+0000 7f6ffe7ec640 -1 mds.b *** got signal Terminated *** 2024-09-21T07:11:17.685 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:17 smithi129 podman[67074]: 2024-09-21 07:11:17.384387692 +0000 UTC m=+4.126170798 container died 7efaf9c999d770b5ceffa7716951e2f53eb4358d67ea2f4bf7c66d7c45d4ca59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:11:18.025 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:17 smithi129 podman[67074]: 2024-09-21 07:11:17.773830272 +0000 UTC m=+4.515613371 container cleanup 7efaf9c999d770b5ceffa7716951e2f53eb4358d67ea2f4bf7c66d7c45d4ca59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T07:11:18.026 INFO:journalctl@ceph.mds.b.smithi129.stdout:Sep 21 07:11:17 smithi129 bash[67074]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-b 2024-09-21T07:11:18.171 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T07:11:18.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:18.207 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T07:11:18.207 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T07:11:18.207 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.e 2024-09-21T07:11:18.606 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:18 smithi129 systemd[1]: Stopping Ceph mds.e for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:18.606 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e[63093]: 2024-09-21T07:11:18.519+0000 7fddefd81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:18.606 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:18 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e[63093]: 2024-09-21T07:11:18.519+0000 7fddefd81640 -1 mds.e *** got signal Terminated *** 2024-09-21T07:11:22.787 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:22 smithi129 podman[67206]: 2024-09-21 07:11:22.534684133 +0000 UTC m=+4.114495986 container died 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T07:11:23.106 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:22 smithi129 podman[67206]: 2024-09-21 07:11:22.894094221 +0000 UTC m=+4.473906075 container cleanup 08090609e6de84a67f293328a12b6fdc28712e1c84534934ff758ebb462dfbd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T07:11:23.106 INFO:journalctl@ceph.mds.e.smithi129.stdout:Sep 21 07:11:22 smithi129 bash[67206]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-e 2024-09-21T07:11:23.273 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T07:11:23.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:23.307 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T07:11:23.307 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T07:11:23.308 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.h 2024-09-21T07:11:23.641 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:23 smithi129 systemd[1]: Stopping Ceph mds.h for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:24.075 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: 2024-09-21T07:11:23.638+0000 7f9a8b09c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:24.075 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:23 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h[63362]: 2024-09-21T07:11:23.638+0000 7f9a8b09c640 -1 mds.h *** got signal Terminated *** 2024-09-21T07:11:26.324 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:26 smithi129 podman[67327]: 2024-09-21 07:11:26.042034731 +0000 UTC m=+2.508087409 container died 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:11:26.606 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:26 smithi129 podman[67327]: 2024-09-21 07:11:26.414318553 +0000 UTC m=+2.880371230 container cleanup 91ff64ddacf6c72566697aeff0b5b3e6ba1692ab1b2d180bfc487f9077867a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:11:26.607 INFO:journalctl@ceph.mds.h.smithi129.stdout:Sep 21 07:11:26 smithi129 bash[67327]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-h 2024-09-21T07:11:26.839 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T07:11:26.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:26.872 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T07:11:26.872 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T07:11:26.872 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.k 2024-09-21T07:11:27.106 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:26 smithi129 systemd[1]: Stopping Ceph mds.k for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:27.606 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k[62812]: 2024-09-21T07:11:27.184+0000 7f7041c1c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:27.606 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:27 smithi129 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k[62812]: 2024-09-21T07:11:27.184+0000 7f7041c1c640 -1 mds.k *** got signal Terminated *** 2024-09-21T07:11:29.277 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:28 smithi129 podman[67449]: 2024-09-21 07:11:28.96621447 +0000 UTC m=+1.884896927 container died 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T07:11:29.277 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:29 smithi129 podman[67449]: 2024-09-21 07:11:29.276475733 +0000 UTC m=+2.195158187 container cleanup 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:11:29.583 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:29 smithi129 bash[67449]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k 2024-09-21T07:11:29.583 INFO:journalctl@ceph.mds.k.smithi129.stdout:Sep 21 07:11:29 smithi129 podman[67461]: 2024-09-21 07:11:29.469010127 +0000 UTC m=+0.499041793 container remove 736e7a637dc671dc7c2fa0dff8c90a87e53800cb4d18d9f2c8bee88bed08fb66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T07:11:29.604 DEBUG:teuthology.orchestra.run.smithi129:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T07:11:29.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:29.635 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T07:11:29.635 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T07:11:29.635 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.c 2024-09-21T07:11:29.955 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:29 smithi181 systemd[1]: Stopping Ceph mds.c for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:30.214 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: 2024-09-21T07:11:29.952+0000 7f444c874640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:30.214 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:29 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c[63214]: 2024-09-21T07:11:29.952+0000 7f444c874640 -1 mds.c *** got signal Terminated *** 2024-09-21T07:11:34.269 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:33 smithi181 podman[66863]: 2024-09-21 07:11:33.967881032 +0000 UTC m=+4.133132739 container died 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T07:11:34.613 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 podman[66863]: 2024-09-21 07:11:34.395011628 +0000 UTC m=+4.560263337 container cleanup 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T07:11:34.614 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 bash[66863]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c 2024-09-21T07:11:34.829 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T07:11:34.853 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 podman[66888]: 2024-09-21 07:11:34.612518784 +0000 UTC m=+0.642179473 container remove 9f7db5bf18bee808720243c6b23d1a6cd7d18bf905b59b92b61a95eb69a1e8c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:11:34.854 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.c.service: Deactivated successfully. 2024-09-21T07:11:34.854 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 systemd[1]: Stopped Ceph mds.c for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:11:34.854 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 07:11:34 smithi181 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.c.service: Consumed 1.435s CPU time. 2024-09-21T07:11:34.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:34.866 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T07:11:34.866 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T07:11:34.867 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.f 2024-09-21T07:11:35.183 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:34 smithi181 systemd[1]: Stopping Ceph mds.f for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:35.519 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: 2024-09-21T07:11:35.181+0000 7f2ff415c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:35.519 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:35 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f[62942]: 2024-09-21T07:11:35.181+0000 7f2ff415c640 -1 mds.f *** got signal Terminated *** 2024-09-21T07:11:38.519 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:38 smithi181 podman[66996]: 2024-09-21 07:11:38.050824841 +0000 UTC m=+2.962281030 container died e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T07:11:38.858 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:38 smithi181 podman[66996]: 2024-09-21 07:11:38.673268344 +0000 UTC m=+3.584724541 container cleanup e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:11:38.858 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:38 smithi181 bash[66996]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f 2024-09-21T07:11:39.104 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T07:11:39.126 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:38 smithi181 podman[67008]: 2024-09-21 07:11:38.857463118 +0000 UTC m=+0.803699412 container remove e52b33f81b48d741f4615376567bcf6a0e034a2bcb1c0fac059a906e0fb825ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True) 2024-09-21T07:11:39.126 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:39 smithi181 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.f.service: Deactivated successfully. 2024-09-21T07:11:39.126 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:39 smithi181 systemd[1]: Stopped Ceph mds.f for 7b450f7c-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:11:39.126 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 07:11:39 smithi181 systemd[1]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.f.service: Consumed 1.421s CPU time. 2024-09-21T07:11:39.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:39.138 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T07:11:39.139 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T07:11:39.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.i 2024-09-21T07:11:39.453 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:39 smithi181 systemd[1]: Stopping Ceph mds.i for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:39.769 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:39 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: 2024-09-21T07:11:39.451+0000 7f7b68337640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:39.769 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:39 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i[63485]: 2024-09-21T07:11:39.451+0000 7f7b68337640 -1 mds.i *** got signal Terminated *** 2024-09-21T07:11:42.296 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:42 smithi181 podman[67117]: 2024-09-21 07:11:42.035605132 +0000 UTC m=+2.676684564 container died 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T07:11:42.654 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:42 smithi181 podman[67117]: 2024-09-21 07:11:42.385334208 +0000 UTC m=+3.026413639 container cleanup 66c8c5f6d763b5f87fe4f0436f0e7ded7007bc59d88b30a969fc94838b8442dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T07:11:42.654 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 07:11:42 smithi181 bash[67117]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-i 2024-09-21T07:11:42.818 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T07:11:42.849 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:42.849 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T07:11:42.849 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T07:11:42.849 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.l 2024-09-21T07:11:43.165 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:42 smithi181 systemd[1]: Stopping Ceph mds.l for 7b450f7c-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:11:43.519 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-l[62671]: 2024-09-21T07:11:43.163+0000 7f762f41c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:11:43.519 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:43 smithi181 ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-l[62671]: 2024-09-21T07:11:43.163+0000 7f762f41c640 -1 mds.l *** got signal Terminated *** 2024-09-21T07:11:46.740 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:46 smithi181 podman[67238]: 2024-09-21 07:11:46.451827088 +0000 UTC m=+3.381264041 container died 2b5c6a77d936f48f14957c12169fe1da69284266d817a7496abb5de12cb07634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:11:47.019 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:46 smithi181 podman[67238]: 2024-09-21 07:11:46.838602538 +0000 UTC m=+3.768039499 container cleanup 2b5c6a77d936f48f14957c12169fe1da69284266d817a7496abb5de12cb07634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:11:47.019 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 07:11:46 smithi181 bash[67238]: ceph-7b450f7c-77e6-11ef-baf5-efdc52797490-mds-l 2024-09-21T07:11:47.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b450f7c-77e6-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T07:11:47.289 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:11:47.289 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T07:11:47.289 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:11:47.502 INFO:teuthology.orchestra.run.smithi028.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:50.089 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:11:50.292 INFO:teuthology.orchestra.run.smithi129.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:52.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:11:52.974 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:55.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:11:55.426 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:11:55.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:11:55.484 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T07:11:55.486 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi028/crash 2024-09-21T07:11:55.487 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:11:55.530 INFO:teuthology.orchestra.run.smithi028.stderr:tar: /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:11:55.530 INFO:teuthology.orchestra.run.smithi028.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:11:55.533 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi129/crash 2024-09-21T07:11:55.533 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:11:55.584 INFO:teuthology.orchestra.run.smithi129.stderr:tar: /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:11:55.584 INFO:teuthology.orchestra.run.smithi129.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:11:55.586 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi181/crash 2024-09-21T07:11:55.587 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:11:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:11:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:11:55.628 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T07:11:55.628 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:11:55.671 INFO:tasks.cephadm:Compressing logs... 2024-09-21T07:11:55.671 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:11:55.713 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:11:55.716 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:11:55.739 INFO:teuthology.orchestra.run.smithi028.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T07:11:55.739 INFO:teuthology.orchestra.run.smithi028.stderr:: No such file or directory 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T07:11:55.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.7% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:11:55.744 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T07:11:55.744 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log: -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:11:55.751 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:11:55.751 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T07:11:55.752 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log: 86.6% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:11:55.752 INFO:teuthology.orchestra.run.smithi028.stderr: 95.0% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T07:11:55.752 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T07:11:55.752 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T07:11:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T07:11:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:: No such file or directory 2024-09-21T07:11:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T07:11:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose --/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T07:11:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr: 95.1% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log: 86.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:11:55.756 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T07:11:55.758 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.1% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T07:11:55.758 INFO:teuthology.orchestra.run.smithi028.stderr: 90.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:11:55.761 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T07:11:55.761 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T07:11:55.761 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log: 90.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:11:55.761 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log: 95.0% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T07:11:55.763 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr: 82.8% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose --/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log: /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr: 90.3% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T07:11:55.764 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T07:11:55.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log: 91.8% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T07:11:55.765 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:11:55.765 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T07:11:55.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:11:55.765 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:11:55.769 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T07:11:55.769 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:11:55.773 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T07:11:55.778 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/cephadm.log: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:11:55.780 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:11:55.782 INFO:teuthology.orchestra.run.smithi181.stderr: 92.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T07:11:55.785 INFO:teuthology.orchestra.run.smithi028.stderr: 92.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T07:11:55.798 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T07:11:55.802 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T07:11:55.826 INFO:teuthology.orchestra.run.smithi129.stderr: 93.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T07:11:55.923 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T07:11:55.957 INFO:teuthology.orchestra.run.smithi028.stderr: 90.0% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T07:11:56.002 INFO:teuthology.orchestra.run.smithi129.stderr: 91.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T07:11:56.019 INFO:teuthology.orchestra.run.smithi129.stderr: 92.7% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T07:11:56.065 INFO:teuthology.orchestra.run.smithi028.stderr: 92.7% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T07:11:56.085 INFO:teuthology.orchestra.run.smithi181.stderr: 92.7% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T07:11:56.235 INFO:teuthology.orchestra.run.smithi028.stderr: 92.6% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T07:11:56.238 INFO:teuthology.orchestra.run.smithi129.stderr: 93.0% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T07:11:56.272 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T07:11:56.379 INFO:teuthology.orchestra.run.smithi028.stderr: 90.6% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T07:11:56.519 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T07:11:56.641 INFO:teuthology.orchestra.run.smithi129.stderr: 93.6% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T07:11:56.687 INFO:teuthology.orchestra.run.smithi129.stderr: 93.3% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T07:11:56.693 INFO:teuthology.orchestra.run.smithi028.stderr: 93.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T07:11:56.718 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T07:11:56.720 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-21T07:11:56.720 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m0.990s 2024-09-21T07:11:56.720 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m2.857s 2024-09-21T07:11:56.720 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.129s 2024-09-21T07:11:56.788 INFO:teuthology.orchestra.run.smithi129.stderr: 93.4% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T07:11:56.790 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-09-21T07:11:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m1.059s 2024-09-21T07:11:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m3.882s 2024-09-21T07:11:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.156s 2024-09-21T07:11:56.854 INFO:teuthology.orchestra.run.smithi028.stderr: 93.5% -- replaced with /var/log/ceph/7b450f7c-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T07:11:56.856 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-21T07:11:56.856 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m1.128s 2024-09-21T07:11:56.856 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m3.672s 2024-09-21T07:11:56.856 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m0.137s 2024-09-21T07:11:56.856 INFO:tasks.cephadm:Archiving logs... 2024-09-21T07:11:56.856 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi028/log 2024-09-21T07:11:56.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:11:57.404 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi129/log 2024-09-21T07:11:57.405 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:11:57.947 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi181/log 2024-09-21T07:11:57.948 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:11:58.372 INFO:tasks.cephadm:Removing cluster... 2024-09-21T07:11:58.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:11:58.588 INFO:teuthology.orchestra.run.smithi028.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:58.857 DEBUG:teuthology.orchestra.run.smithi129:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:11:59.059 INFO:teuthology.orchestra.run.smithi129.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:59.320 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b450f7c-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:11:59.520 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 7b450f7c-77e6-11ef-baf5-efdc52797490 2024-09-21T07:11:59.780 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T07:11:59.780 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:11:59.799 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:11:59.815 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:11:59.831 INFO:tasks.cephadm:Teardown complete 2024-09-21T07:11:59.831 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:11:59.842 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:11:59.842 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:11:59.845 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:11:59.858 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:11:59.968 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:11:59.978 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:11:59.979 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:11:59.981 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:11:59.983 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:11:59.996 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:11:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:11:59.997 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +37us[ +38us] +/- 39ms 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -114us[ -114us] +/- 49ms 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +116us[ +116us] +/- 86ms 2024-09-21T07:12:00.001 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +34us[ +36us] +/- 39ms 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -119us[ -117us] +/- 49ms 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +106us[ +107us] +/- 86ms 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:12:00.003 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T07:12:00.004 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +36us[ +41us] +/- 39ms 2024-09-21T07:12:00.004 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -75us[ -70us] +/- 49ms 2024-09-21T07:12:00.004 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +108us[ +108us] +/- 86ms 2024-09-21T07:12:00.004 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:12:00.004 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:12:00.014 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:12:00.015 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:12:00.023 DEBUG:teuthology.orchestra.run.smithi028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:12:00.123 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:12:00.189 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:12:00.272 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:12:00.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:00.303 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:12:00.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:00.331 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:12:00.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:00.358 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:12:00.372 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:12:00.382 INFO:teuthology.task.internal:Duration was 1355.799104 seconds 2024-09-21T07:12:00.382 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:12:00.392 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:12:00.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:12:00.397 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:12:00.400 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:12:00.436 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:12:00.437 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:12:00.439 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:12:00.898 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:12:00.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-09-21T07:12:00.899 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:12:00.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-09-21T07:12:00.925 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:12:00.965 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T07:12:00.965 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:12:01.004 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:12:01.005 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:12:01.007 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:12:01.010 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:12:01.071 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:12:01.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:12:01.079 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:12:01.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:12:01.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:12:01.570 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:12:01.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:12:01.596 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:12:01.622 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:12:01.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:12:01.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.660 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.682 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-09-21T07:12:01.685 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-09-21T07:12:01.711 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-21T07:12:01.744 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:01.759 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:01.785 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:01.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:01.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:12:01.810 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:12:01.811 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi028 2024-09-21T07:12:01.811 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:12:01.856 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi129 2024-09-21T07:12:01.856 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:12:01.891 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913572/remote/smithi181 2024-09-21T07:12:01.891 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:12:01.926 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:12:01.926 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:12:01.929 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:12:01.931 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:12:01.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:12:01.993 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:12:01.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:12:02.024 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:12:02.024 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:12:02.026 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:12:02.029 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:12:02.040 INFO:teuthology.orchestra.run.smithi028.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:12 /home/ubuntu/cephtest 2024-09-21T07:12:02.042 INFO:teuthology.orchestra.run.smithi129.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:12 /home/ubuntu/cephtest 2024-09-21T07:12:02.043 INFO:teuthology.orchestra.run.smithi181.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:12 /home/ubuntu/cephtest 2024-09-21T07:12:02.045 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:12:02.055 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:12:02.078 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1355.799103975296 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T07:12:02.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:12:02.175 INFO:teuthology.run:pass